Job Title: Linguistic Expert LLM Evaluation & Training
Location: Remote (Egypt)
Employment Type: Contract
Language: Arabic and English
About the Role
We are looking for a Linguistic Expert with strong experience in language analysis and hands-on familiarity with Large Language Models (LLMs). In this role, you will evaluate, refine, and improve AI-generated content to enhance model accuracy, linguistic quality, and cultural/semantic correctness.
Key Responsibilities
- Evaluate AI/LLM-generated text for accuracy, coherence, linguistic quality, and cultural relevance.
- Annotate, correct, and refine model outputs across various domains.
- Develop high-quality prompts, test cases, and linguistic guidelines for model improvement.
- Collaborate with AI researchers and engineers to provide linguistic insights during model evaluation and training.
- Identify errors in grammar, semantics, pragmatics, tone, and factual correctness.
- Support creation and improvement of datasets used for training and fine-tuning LLMs.
- Maintain consistency with language conventions, style guides, and project-specific requirements.
Requirements
- Bachelor's or Master's degree in Linguistics, Applied Linguistics, English Language, Translation Studies, or related field preferred.
- Strong understanding of grammar, syntax, semantics, pragmatics, and discourse analysis.
- Working knowledge of LLMs (e.g., GPT, Claude, Gemini) and experience evaluating or interacting with AI models.
- Excellent written communication skills and attention to detail.
- Ability to assess linguistic nuances across different domains and contexts.
- Experience in content evaluation, annotation, or linguistic QA is a plus.