How to make LLM run faster with huge text file?

What is the name of the modal you’re running?

I am currently working on an LLM using the mistral AI model

What is the error number?

Im trying to create a chatbot for a project but basically it needs a lot of context so I quite basically rammed up an entire 41KB text file in its instructions-- and now it is slow… very slow.

What is the issue or error you’re encountering

so I was wondering if there was a way i could make it faster e.g break down the file into multiple files or change the model etc.

I also forgot to mention
im planning (or ‘was planning’ because now its too slow) to add another 40KB file as well
so…yeah :slight_smile: