Building a Scalable Ingestion Pipeline with Temporal (Part 2)
Heartbeats, cancellation, approval gates, scheduling, observability, and the operational patterns that made our Temporal ingestion pipeline easier to run.
All posts
Dipkumar Patel
Founding Engineer at Rapidflare
Founding Engineer at Rapidflare. Previously a backend engineer at fabric on the loyalty team, and earlier built ML systems and a pre-LLM AI research assistant at RAx (acquired by Enago) and Fero.Ai.
5 posts
Building a Scalable Ingestion Pipeline with Temporal (Part 1)
How we built a document ingestion system that handles massive sources using Temporal's workflow orchestration, and the design decisions that made it scale.
Agents Can Reason. They Still Can't Really Search.
Agents have a search problem across the whole stack: web search, RAG, tool discovery, skills/workflow loading, and even context compaction.
Building Scalable Technical Support for Engineering Communities in Electronics Manufacturing
Learn how Rapidflare built a scalable, secure Discord integration using webhooks, strong access controls, and native UX for large developer communities.
A Practical Guide to Recall, Precision, and NDCG
Step-by-step guide to optimizing RAG retrieval - improve recall, precision, and ranking for LLMs.