Built fast “agentic” apps with FastAPIs. Not a joke post.
I wrote this post on how we built the fastest function calling LlM for agentic scenarios https://www.reddit.com/r/LocalLLaMA/comments/1hr9ll1/i_built_a_small_function_calling_llm_that_packs_a//
A lot of people thought it was a joke.. So I added examples/demos in our repo to show that we help developers build the following scenarios. Btw the above the image is of an insurance agent that can be built simply by exposing your APIs to Arch Gateway.
🗃️ Data Retrieval: Extracting information from databases or APIs based on user inputs (e.g., checking account balances, retrieving order status). F
🛂 Transactional Operations: Executing business logic such as placing an order, processing payments, or updating user profiles.
🪈 Information Aggregation: Fetching and combining data from multiple sources (e.g., displaying travel itineraries or combining analytics from various dashboards).
🤖 Task Automation: Automating routine tasks like setting reminders, scheduling meetings, or sending emails.
🧑🦳 User Personalization: Tailoring responses based on user history, preferences, or ongoing interactions.
I wrote this post on how we built the fastest function calling LlM for agentic scenarios https://www.reddit.com/r/LocalLLaMA/comments/1hr9ll1/i_built_a_small_function_calling_llm_that_packs_a//
A lot of people thought it was a joke.. So I added examples/demos in our repo to show that we help developers build the following scenarios. Btw the above the image is of an insurance agent that can be built simply by exposing your APIs to Arch Gateway.
🗃️ Data Retrieval: Extracting information from databases or APIs based on user inputs (e.g., checking account balances, retrieving order status). F
🛂 Transactional Operations: Executing business logic such as placing an order, processing payments, or updating user profiles.
🪈 Information Aggregation: Fetching and combining data from multiple sources (e.g., displaying travel itineraries or combining analytics from various dashboards).
🤖 Task Automation: Automating routine tasks like setting reminders, scheduling meetings, or sending emails.
🧑🦳 User Personalization: Tailoring responses based on user history, preferences, or ongoing interactions.