AI Quality Analyst & Language Specialist
Piotr
Niesłuchowski
piotrek.niesluchowski@gmail.com · linkedin.com/in/piotr-niesluchowski1 · piotrniesluchowski.pl
human edge
Bringing linguistic judgment and human perspective to AI quality – from output evaluation and safety review to RLHF, annotation QA, and multilingual content assessment for global teams.
Overview
Professional Profile
I am an AI-focused language and quality specialist with extensive experience in AI data annotation, content evaluation, bias category review, and failure mode identification. My background spans evaluating AI-generated content for language quality and safety categories, combined with deep expertise in content localization, linguistic QA, and terminology management.
I excel at applying structured judgment, maintaining consistency, identifying quality issues, and improving content workflows across language, brand, and user-experience dimensions. I thrive in cross-functional, international teams and have collaborated with stakeholders across the US, Denmark, Malaysia, Taiwan, and many other markets worldwide.
Navigating cultural nuance is central to my approach – whether evaluating AI outputs for Polish and English audiences or ensuring global content resonates across markets.
Education
MA in Translatorics
University of Warsaw
2008 – 2013
Thesis: “The Link Between the Goal of Translating Song Lyrics and the Relevant Translation Strategies Adopted”
Location
Poland & Morocco
Remote-first professional
Global collaboration experience
Focus
AI Quality Assurance
Localization & Linguistics
Data Annotation & Evaluation
Languages
Polish – Native
English – Proficient (C2)
Multilingual QA expertise
Career Path
Work Experience
AI Language Specialist | Annotator & Peer Reviewer
- Designed AI agent test scenarios and simulated environments (Gmail, Notes, Google Drive), building realistic personas and datasets to probe agent reasoning, filtering, and prioritization; promoted to Writer Lead (Mercor) supporting over 1,000 writers through office hours and ongoing feedback.
- Wrote and calibrated Polish-language benchmark questions across various domains, producing ten answer options per item (one correct, nine distractors), each wrong answer modelled on a specific mistake a solver would make; promoted to Polish Team Lead (Mercor), directly supporting and reviewing output from a team of 80 writers.
- Evaluated and annotated AI-generated content over 2,000+ hours spanning 4 RLHF and human-in-the-loop projects, covering accuracy, fluency, cultural alignment, and safety (bias, harmfulness); promoted to Reviewer (Mercor) and QA Assistant (Mindy Support) for consistently high task quality.
- Generated adversarial prompts and performed failure-mode analysis to surface safety, policy-compliance, and linguistic gaps in model outputs.
- Evaluated voice AI models for customer service applications over 100+ hours of testing, scoring naturalness, accuracy, and conversational flow; audited transcriptions and peer-reviewed 200+ evaluation sessions to maintain team consistency.
- Performed temporal annotation of multi-speaker video, segmenting and labeling spoken languages, with quality-review responsibilities across the team's output.
- Corrected AI-generated visual question answering (VQA) responses using structured rubrics covering factual accuracy, hallucination detection, completeness, and linguistic correctness.
- Annotated video frame by frame for computer vision training, maintaining precise bounding-box tracking on moving subjects across shot changes.
- Authored and refined annotation guidelines and documentation to improve evaluator consistency; collaborated with researchers on language-specific challenges and edge cases, and provided expert feedback on grammar, semantics, style, and tone.
Senior Language Specialist
- Created and adapted HR and branding content for global markets, ensuring clarity, inclusiveness, and audience fit.
- Reviewed and edited job adverts and adapted them to different markets and cultures, focusing on diverse and inclusive language use.
- Provided guidance to hiring managers on which unique selling points to highlight.
- Collaborated with international stakeholders across the US, Denmark, Malaysia, and Taiwan.
- Trained new team members and interns, supporting onboarding and quality consistency.
Language Specialist
- Led end-to-end Polish localization for product launches and marketing campaigns across B2B and B2C channels.
- Maintained the quality of the Polish version of Booking.com, incl. website checks and maintaining language-specific tools, such as glossaries and style guides.
- Conducted post-editing and quality checks for machine-translated content, managing style guides, glossaries, and translation memories.
- Improved workflows, tested new tools, and shared insights from localization audits and competitor analysis.
- Managed and supported freelancers, evaluated and monitored the quality of their translations, provided them with consistent and regular feedback.
Senior Content Manager
- Wrote and edited deal content for the US site, maintaining brand tone and clarity standards.
- Provided translations for the HR department and Communications team.
- Ensured attractiveness, coherence, and clarity of the Groupon.com website.
Expertise
Skills & Competencies
From platform tooling to evaluation frameworks to cross-cultural deployment, I work across the full annotation pipeline, turning raw data into high-quality, deployment-ready training sets.
Annotation & Evaluation
Annotation Platforms
Localization & QA
CAT Tools & Tech
Creative & Personal
Let’s Connect
Get in Touch
Open to AI quality, localization strategy, prompt evaluation, and conversational AI evaluation roles. Available for remote collaboration worldwide.