Progress Tracking Enables Smarter Learning

Using Learning Analytics to Guide FRCR Part 1 Physics Preparation Radiology trainees are highly motivated learners – but motivation alone is not enough. A consistent finding across educational research is that learners are poor judges of their own competence . Without objective performance data, confidence and understanding drift apart, leading to inefficient revision, misplaced reassurance, or unnecessary anxiety. This is where progress tracking and learning analytics are not optional extras, but essential learning tools . Medical Trainees Systematically Misjudge Competence In their influential JAMA paper, Eva & Regehr 2005  examined self& 8209;assessment accuracy in medical learners and found consistent, systematic error. Learners often overestimate competence in weak areas and underestimate competence in strong ones , particularly in complex, knowledge& 8209;dense domains. Crucially, the authors concluded that self& 8209;assessment accuracy improves only when learners are provided with external performance data , enabling calibration between perceived and actual ability. Eva, Kevin W., and Glenn Regehr. "Self-assessment in the health professions: a reformulation and research agenda." Academic medicine  80, no. Supplement 1 2005 : S46-S54. For FRCR Physics candidates, this matters enormously. Topics such as radiation dose optimisation, MR signal behaviour, or detector physics can feel superficially familiar while concealing critical gaps. Assessment Data Enables Self& 8209;Regulated Learning If learners cannot accurately diagnose their own learning needs, well& 8209;designed assessment data must do that diagnostic work for them . Norcini et& 8239;al. 2011  describe how assessment supports self& 8209;regulated learning  by providing feedback that informs planning, monitoring, and strategy adjustment. Rather than being purely summative, assessment data becomes a signal guiding future learning behaviour . The authors emphasise that performance feedback enables learners to shift effort toward areas of weakness , improving both efficiency and outcomes – provided the data is timely, specific, and interpretable. Norcini, John, Brownell Anderson, Valdes Bollela, Vanessa Burch, Manuel João Costa, Robbert Duvivier, Robert Galbraith et al. "Criteria for good assessment: consensus statement and recommendations from the Ottawa 2010 Conference." Medical teacher  33, no. 3 2011 : 206-214. In this framework, analytics are not about ranking learners; they are about directing attention . Why Topic& 8209;Level Analytics Matter More Than Overall Scores Overall percentages feel reassuring, but they are blunt instruments. Two candidates with identical overall scores may have entirely different risk profiles  for the exam. Contemporary work on formative assessment emphasises that analytics are most powerful when they support individualised feedback and decision& 8209;making . AMEE Guide No. 189 highlights how performance analytics allow for delivery of tailored, personalised feedback  by tracking learner progress over time. Rather than treating each practice question as a single snapshot, analytics reveal stable patterns of strength and weakness, enabling feedback that aligns with each learner’s specific needs. This approach reflects principles of differentiated instruction, which stress that effective learning requires recognising and addressing each trainee’s individual learning needs. By making performance trends visible at the granular topic and sub-topic level, analytics shift remediation from repetitive practice to intentional, targeted intervention . Learners are not simply told how they performed; they are guided toward what requires attention and why. In this way, analytics transform formative assessment with question banks from passive score reporting into an active tool for optimising learning. For FRCR Physics revision, this approach is particularly powerful given the breadth of the syllabus and the uneven distribution of difficulty across domains. Lipnevich, Anastasiya A., Krista Mattern, and Christopher Feddock. "Formative assessment and feedback in medical education: A practical guide: AMEE Guide No. 189." Medical Teacher   2025 : 1-20. Design Principle The evidence leads to a clear design principle: Learners need external data to accurately understand their progress and to study efficiently. In a high& 8209;quality FRCR Part 1 Physics question bank, this means: ·           Persistent progress tracking , not just end& 8209;of& 8209;session scores ·           Topic& 8209;level performance analytics  mapped to exam& 8209;relevant domains ·           Visual indicators of strength, weakness, and improvement over time ·           Data presented clearly enough to support self& 8209;regulated learning decisions When analytics are absent, learners rely on intuition. When analytics are present, they rely on evidence. Our Approach Our FRCR Part 1 Physics question bank integrates progress tracking and learning analytics  to help trainees see what matters – not just what feels familiar. Because confidence without data is guesswork. And revision guided by data is revision that works.