Back to Independent Research
llm.karanmertiya.me
An ambitious project involving the deployment and serving of large language models.
The Problem
Self-hosting open-source LLMs typically requires complex setup and expensive hardware resources.
The Solution
Configured and optimized the serving infrastructure for a custom LLM deployment accessible via the web.
Interactive Demo
Launch Live Demo
Interact with llm.karanmertiya.me in a secure sandbox environment
Tech Stack
PythonPyTorchLLMsDocker