<section class="section1" style="text-align: center;"><h1>Numbas Update</h1> <p style="text-align: center; font-size: 1.2em;">Chris Graham - Digital Assessment Group</p> <div id="branding"> <div> <a href="https://www.ncl.ac.uk" target="_blank"> <img alt="Newcaste University" class="nulogo" src="../../static/images/logos/newcastle-university-logo.png"/> </a> <p>School of Mathematics, Statistics & Physics Digital Learning Unit</p> </div> <div class="container"> <div class="col"> <a href="https://numbas.org.uk" target="_blank"> <img alt="Numbas" class="numbas" src="../../static/images/logos/numbas.png"/> </a> </div> <div class="col"> <a href="https://www.advance-he.ac.uk/cate-team/e-learning-unit-school-mathematics-statistics-physics-newcastle-university" target="_blank"> <img alt="Collaborative Awards for Teaching Excellence (CATE) winners 2020" class="cate" src="../../static/images/logos/cate.png"/> </a> </div> <div class="col"> <a href="https://chirun.readthedocs.io/en/latest/" target="_blank"> <img alt="Chirun" class="chirun" src="../../static/images/logos/chirun.png"/> </a> </div> </div> </div> <hr/> <section class="section2"><h2>In this update</h2> <p>I'm focussing on Numbas for exams / summative assessment</p> <ul> <li>New Numbas application</li> <li>New exam lockdown mechanism</li> <li>New assessment possibilities: hybrid and whitelisting</li> </ul> <figure class="figure1" data-title="Numbas"><img alt="Numbas" src="../../static/images/digitalassessment/exams.png" style="width: 500px;"/></figure><hr/> </section><section class="section2"><h2>Not in this update</h2> <p>I'm not covering the core of what Numbas can do, only updates on how we're using Numbas at Newcastle. See <a href="https://www.numbas.org.uk" target="_blank">numbas.org.uk</a> for full details and a demo.</p> <figure class="figure2" data-title="Numbas"><img alt="Numbas" src="../../static/images/bgs/montagenumbas.png" style="width: 500px;"/></figure><hr/> </section><section class="section2"><h2>In-course assessment</h2> <p>Numbas was used for 50,000 assessment attempts (formative + summative) across 45 modules in semester 1.</p> <div class="fragment"> <p>The New Numbas application integrates closely with Canvas to launch automatically if installed (like Zoom). </p> <p>We strongly recommend using this for summative assessment.</p> </div><hr/> </section><section class="section2"><h2>Exam lockdown</h2> <p>Last year we used Inspera to launch Numbas assessments: complicated, unfamiliar to students and with too many login steps before the exam start. </p> <div class="fragment"> <p>In semester 1, we moved to Safe Exam Browser, which is a much slicker start to exams.</p> </div><hr/> </section><section class="section2"><h2>SEB & Numbas integration</h2> <video controls="" height="405" style="border: 1px solid #333;" width="720"> <source src="../../static/images/digitalassessment/seb.mp4" type="video/mp4"/> </video> <hr/> </section><section class="section2"><h2>Whitelisting</h2> <p>We have tested and run exams using whitelisting in semester 1: SPSS and OneNote used so far.</p> <p>One use case is that Numbas can generate files to work with in e.g. SPSS, R, MATLAB, Python and mark student's subsequent answers.</p> <figure class="figure3" data-title="Numbas"><img alt="Numbas" src="../../static/images/digitalassessment/spss.png" style="width: 500px; border: 1px solid #CCC !important;"/></figure><hr/> </section><section class="section2"><h2>Hybrid formats</h2> <p>For maths and other subject, assessing handwritten mathematics is important and a barrier for digital assessments. </p> <div class="fragment"> <p>Hybrid formats offer a solution to focus marking time where it is needed.</p> <ul> <li> <p>Free text box for answers marked later</p> </li> <li> <p>Write on an answer book questions</p> </li> </ul> <figure class="figure4" data-title="Numbas"><img alt="Numbas" src="../../static/images/digitalassessment/hybrid.png" style="width: 700px; border: 1px solid #CCC !important;"/></figure></div><hr/> </section><section class="section2"><h2>Take home exams</h2> <p>In Maths, Stats & Physics, we're also using hybrid formats, with parts of questions where students upload their work to Canvas for manual marking.</p> <p>Programming is a good example, allowing auto-marking of code, but e.g. plots marked manually.</p> <video controls="" height="405" style="border: 1px solid #333;" width="720"> <source src="../../static/images/digitalassessment/coding.mp4" type="video/mp4"/> </video> <hr/> </section><section class="section2"><h2>Looking ahead</h2> <p><strong>For semester 2:</strong></p> <ul> <li>More guidance for colleagues preparing Numbas exams, in terms of settings to use and backup papers.</li> </ul> <p><strong>Challenges:</strong></p> <ul> <li>Safe Exam Browser will require ongoing support to run Numbas exams, if Inspera exams move to IEP.</li> <li>Instructions for hybrid need to be clear.</li> </ul> <hr/> </section><section class="section2"><h2>Questions?</h2> </section></section>