Course management service that enables auto-graded programming assignments.
Autolab is a course management service, initially developed by a team of students at Carnegie Mellon University, that enables instructors to offer autograded programming assignments to their students over the Web. The two key ideas in Autolab are autograding, that is, programs evaluating other programs, and scoreboards.
Autolab also provides other services that instructors expect in a course management system, including gradebooks, rosters, handins/handouts, lab writeups, code annotation, manual grading, late penalties, grace days, cheat checking, meetings, partners, and bulk emails.
Since 2010, Autolab has had a transformative impact on education at CMU. Each semester, it is used by about 5,000 CMU students in courses in Pittsburgh, Silicon Valley, Qatar, and Rwanda. In Fall, 2014, we are releasing Autolab as an open-source system, where it will be available to schools all over the world, and hopefully have the same impact it's had at CMU.
Subscribe to our mailing list to recieve announcements about major releases and updates to the Autolab Project.
We have a demo site running at https://demo.autolabproject.com/. See the docs for more information on how to login and suggestions on things to try.
We released new documentation! Check it out here.
We are currently in the process of updating our documentation to work with our newest release of Autolab, v2.5.0, which has been upgraded to Rails 5 from Rails 4
Add a test database in
Create and migrate the database.
sh RAILS_ENV=test bundle exec rails db:create RAILS_ENV=test bundle exec rails db:migrateDo not forget to use
RAILS_ENV=test bundle execin front of every rake/rails command.
Create necessary directories.
mkdir attachments/ tmp/
After setting up the test environment, simply run spec by:
bundle exec rails spec
Autolab is now running on Rails 5. However, we may still work on important bug fixes on the Rails 4 branch, partially because the deployment on CMU is currently still on Rails 4. Please file an issue if you believe that you have found a severe bug. The Rails 4 branch can be found on
We will not be backporting new features from
To install mkdocs, run
bash pip install --user mkdocs
We rely on the
mkdocs-materialtheme, which can be installed with
bash pip install --user mkdocs-material
To run and preview this locally, run:
Once your updated documentation is in
This will build the site using the branch you are currently in (hopefully
master), place the built HTML files into the
gh-pagesbranch, and push to GitHub. GitHub will then automatically deploy the new content in
Finally, go to the repository Settings page, and set
Autolab is released under the Apache License 2.0.
Please feel free to use Autolab at your school/organization. If you run into any problems, you can reach the core developers at
score = max_score + ∑(annotation score changes)- For example, a way to grade style in a deductive manner would be to set the max score for the Style problem, and make annotations with negative score for style violations and zero score for good style
UI Enhancements - Tables are more standardized - Fixed text overflowing issues on Gradebook modals - Improved standardization and UI for annotations on PDF submissions
Others - Course assistants are now able to submit assignments early