LLM APIs with HTTP Polling, Kafka & Redis
An asynchronous approach to processing intensive LLM tasks using HTTP Polling, Kafka and Redis.
๐ For the notes, join my newsletter:
https://irtizahafiz.com/newsletter?utm_source=youtube_channel
๐ป For the code, check Github:
https://github.com/irtiza07/public_api/tree/main/logic/llm_processing_async_kafka
0:00 Introduction
0:20 HTTP Polling
2:42 Kafka & Redis Pipeline
5:20 Decoupled Kafka Consumers
7:00 Summary
Watch on YouTube โ
(saves to browser)
Chapters (5)
Introduction
0:20
HTTP Polling
2:42
Kafka & Redis Pipeline
5:20
Decoupled Kafka Consumers
7:00
Summary
DeepCamp AI