Genkit Middleware: Intercept, extend, and harden your agentic apps Blog (developers.googleblog.com)

Genkit has unveiled a powerful open-source middleware framework designed for developing full-stack, AI-driven applications using languages like TypeScript, Go, Dart, and soon Python. This framework addresses the complexities of building reliable agentic applications by allowing developers to implement customizable middleware hooks that intercept tool execution loops. These hooks offer functionality such as retries for transient errors, human approval for certain tool actions, and detailed logging, significantly enhancing robustness and flexibility in AI applications. The significance of Genkit lies in its ability to simplify complex application logic through middleware that can be easily stacked and composed. This enables developers to enforce rules consistently, manage errors efficiently, and tailor interactions based on specific needs. For instance, developers can create middleware for content filtering, ensuring compliance with business rules while streamlining the application’s workflow. With pre-built solutions available and the option to create custom middleware, Genkit empowers the AI/ML community to build more resilient and context-aware applications, promoting a new paradigm in application development.