Introducing Evaluations, a powerful feature designed to enable you to effortlessly test and compare a selection of AI models against your datasets.
Whether you're fine-tuning models or evaluating performance metrics, Oxen evaluations simplifies the process, allowing you to quickly and easily run prompts through an entire dataset.
Once you're happy with the results, output the resulting dataset to a new file, another branch, or directly as a new commit.
38f412a0-81ab-441a-9621-d06bb4a91375
Meta/Llama 3.1 405B Instruct Turbotext → texteloy
2 months agoPlease evaluate the information provided in {text} and determine whether it is relevant and useful for assessing the company's performance. Respond with "yes" if it is useful and relevant, or "no" if it is not.
Just output "yes" or "no" all lowercaps. do not output anything else other than "yes" or "no".fa0e3b07-b7da-4a1a-ba14-a1484ce9b7f8
Meta/Llama 3.1 405B Instruct Turbotext → texteloy
2 months agoPlease evaluate the information provided in {text} and determine whether it is relevant and useful for assessing the company's performance. Respond with "yes" if it is useful and relevant, or "no" if it is not.
Just output "yes" or "no" all lowercaps. do not output anything else other than "yes" or "no". error An exception occurred indexing, getting dataframe and running evaluation: %Req.TransportError{reason: :closed} 120 / 5253 rows17844 tokens$ 0.0523 3 iterations
e1e1a2f5-fdf4-43a1-a898-c151641311df
DeepSeek/Deepseek V3text → texteloy
2 months agoPlease evaluate the information provided in {text} and determine whether it is relevant and useful for assessing the company's performance. Respond with "yes" if it is useful and relevant, or "no" if it is not.
Just output "yes" or "no". do not output anything else other than "yes" or "no". error An exception occurred indexing, getting dataframe and running evaluation: %Req.TransportError{reason: :econnrefused} 5130 / 5253 rows643836 tokens$ 0.5795 5 iterations
39a738ed-357d-4bed-b6cd-12b64d315723
OpenAI/Text Embeddings Small v3text → embeddingseloy
2 months agotext
error no case clause matching: {:error, "resource_not_found", 0, 0} 887 rows299994 tokens$ 0.0060 3 iterations
a0e9f060-da93-4468-ae62-295bce207ca0
OpenAI/Text Embeddings Small v3text → embeddingseloy
2 months agotext