Proposal: Integrating Ollama Support for AP2

[diptendulkar]

Ollama allows developers to run powerful LLMs (like Llama 3, Mistral, Gemma) locally on developers hardware. This eliminates the token cost associated with proprietary APIs and removes the dependency on expiring free tiers or paid subscriptions, which is crucial for OSS contributions.