Response Comparison Rater

The Response Comparison Rater role is a part-time, fully remote position focused on the quality and logic of written text. You will look at various outputs from language models and determine which ones communicate most effectively based on a specific set of guidelines. This work helps ensure that the tools being built are helpful, accurate, and free of the vague language that often clutters professional communication.


About the Role

In this role, you will help us evaluate the performance of AI models by comparing their generated responses. Olive Tree Consulting values clarity and brevity, and this position supports that goal by identifying which machine-generated answers are truly useful and which are simply filler. You will be looking at prompts and assessing pairs of responses for factual accuracy, logical consistency, and tone. This is an entry-level contract position that requires no previous experience in consulting or data science, but it ...