LingJudge – A Platform for Collecting Linguistic Judgment Data
https://linguistlist.org/issues/36/2182/
LingJudge (www.lingjudge.eu) is a free-to-use, MIT-licensed, Django-based
platform designed for collecting linguistic judgments from native speakers,
created to support experimental and exploratory research in linguistics. It
offers a clean, intuitive interface for both researchers and participants,
streamlining the workflow of designing, distributing, and collecting
structured judgment tasks.
Key Features
Supported Task Types:
* Likert Scale: Sentence ratings on a customizable scale (2–10 points), with
researcher-defined endpoints (e.g., "ungrammatical" ↔ "grammatical").
* Forced Choice: Participants choose between two sentences (with or without
context), allowing fine-grained grammaticality contrasts or pragmatic
judgments.
Task Creation:
* Create tasks via a simple web form.
* Add items individually or upload in bulk using CSV.
* Include task instructions, set the target language, randomize item order,
and preview the task before publishing.
Participant Experience:
* Native Language Filtering: The task feed is personalized—participants only
see tasks matching their registered native language(s).
* Item-by-Item Flow: Tasks are presented one item at a time, with a progress
bar and simple navigation.
* Completion Time Tracking: Response times are logged for each participant.
Results & Data:
* Researchers can download results as CSV files, including metadata such as
user ID, native languages, response times, and timestamps.
* Results are grouped by participant and include all relevant task and item
details.
User Profiles & Access:
* Registration includes native language(s), date of birth, and optional
affiliation.
* Authenticated users have access to a personal dashboard for task creation,
participation, results management, and profile editing.
* Users cannot view or participate in their own tasks, and cannot repeat tasks
they have already completed.
Privacy & Participation:
* Only authenticated users can create or complete tasks.
* No personal data is shown publicly—user IDs are stored internally for
result tracking.
* The platform is free to use for both researchers and participants.
Email Alerts:
* When a new task is published, all users with a matching native language
receive an email notification informing them that a new task is available.
* Notifications can be easily disabled from the user’s profile settings.
LingJudge is now fully operational and available at www.lingjudge.eu.
It's open for anyone to explore it, use it in their research or teaching, and
share it with students and colleagues.
Feedback on features, bugs, or new use cases is always welcome!