API Hosted Inference

Changes to Run paid OpenAI-compatible inference

post/v1/chat/completions