Tag Archives: realtime
Hot Potato – A Real-time Processing Framework
Today, I am happy to announce the availability of HotPotato. Hot Potato is an open source real-time processing framework written in Ruby. Originally designed to process the Twitter firehose at 3,000+ tweets per second, it has been extended to support … Continue reading
Efficient Real-Time Memory De-duplication
De-duplication is the process of removing duplicates from a collection. Hashes and bloom filters are common tools to use when implementing de-duplication, however, there are times when these are not fast enough. It is fairly simple to implement a memory … Continue reading
Realtime Log Visualization
Erlend Simonsen put out a program called gltail that creates a graphical representation of your log files. I saw this a long time ago, but last night I finally started playing with it. It works quite well. I needed to … Continue reading
Yahoo Search Index Speed
I submitted this blog to Yahoo a while ago. Why? It was more of a test of how fast they spider sites rather than an attempt to drive traffic. After the submission, they stated: Thank you! Your URL has been … Continue reading
