Geeky Gadgets

How to use Gemini AI API function calling and more

The introduction of Google’s Gemini API marks a significant step forward for those who develop software and create digital content. The API allows you to harness the power of Google’s latest ...

The difference between ECS task roles and task execution roles is 'who calls the AWS API'

IntroductionThere are two fields for setting roles in an Amazon ECS (Elastic Container Service) task definition: the "task ...
Geeky Gadgets

Improve AI Function Calling with Groq API

The Groq API has introduced official support for function calling, enhancing the interaction between language models and the external world through API calls. This new feature allows for a variety of ...

Implementation Design for LLM API Parallel Calls and Rate Limiting

Implementation Design for LLM API Parallel Calls and Rate LimitingThe "Throughput Problem" That Rapidly Emerges in Production ...
InfoQ

UC Berkeley Researchers Open-Source API-Calling Language Model Gorilla

Researchers from UC Berkeley and Microsoft Research have open-sourced Gorilla, a large language model (LLM) that can write code to call APIs. In experiments measuring generated code accuracy, Gorilla ...
InfoWorld

LiteLLM: An open-source gateway for unified LLM access

LiteLLM allows developers to integrate a diverse range of LLM models as if they were calling OpenAI’s API, with support for fallbacks, budgets, rate limits, and real-time monitoring of API calls. The ...