ORBIT

ORBIT is a robot programming app I co-designed with special education teachers so that autistic middle schoolers could learn to code without the interface getting in the way.

The name stands for Opportunities for Robotics, Building, and Inclusive Technology. It is an NSF funded program run out of the Center for Engineering Education and Outreach at Tufts, and the app sits at the center of it. The unusual part is the pairing: computational thinking taught alongside executive functioning, the planning, sequencing, and task switching skills many of these students are already working on in class.

We built it with the teachers rather than for them. Three co-design workshops across eighteen months with autism specialists from Somerville Public Schools, then classroom pilots with their students. The prototype runs in React and talks to LEGO SPIKE Prime hubs over Bluetooth Low Energy.

The interface has two modes. Mission gives students structured scenarios broken into sub-tasks. Sandbox is open exploration. Both split into three panels that read left to right, following the order you would actually think in: Steps Menu, Coding Track, Command Panel.

Design decisions came from the PRADA framework for computational thinking, pattern recognition, abstraction, decomposition, and algorithms, layered with accessibility considerations for working memory, inhibitory control, and task switching. Option menus collapse by default so nothing is being held in the head that does not need to be. Every element is represented more than one way, through icons, text, animation, and text to speech.

The pilots showed the app supporting students’ individualized learning goals, especially around executive functioning, and opening real chances for PRADA-aligned thinking. They also surfaced a tension I keep coming back to: scaffold enough for access without capping what an advanced student is allowed to do.

Role
UX Researcher and Designer
Lab
Center for Engineering Education and Outreach, Tufts University
PI
Jennifer Cross, Ph.D. Co-PI: Elissa Milto, M.Ed.
Funding
NSF Award No. 2318191
Partners
Special education teachers, Somerville Public Schools
Hardware
LEGO SPIKE Prime
Methods
Co-design workshops, design-based research, structured observation, pilot testing

The publication

IEEE Frontiers in Education 2025, peer reviewed

Hayes, R., Milto, E., Goroza, E., and Cross, J. The paper covers the app’s design rationale, its theoretical framing, and the pilot findings from testing with teachers and with autistic middle school students.

IEEE paper page 2 IEEE paper page 3 IEEE paper page 4

Preview only. Selected pages shown.

V3 prototype

Figma, piloted in classrooms

The third iteration, shaped by teacher feedback and by watching students use V2. It cuts visual clutter in the Steps Menu, rebuilds the Mission scaffolding around a student’s first few minutes with the app, and sharpens how you add, configure, and run a step. Sensor and action options stay collapsed until they are needed.

ORBIT V3 prototype V3 screen V3 screen V3 screen

Preview only. Selected screens shown.

V2 prototype

Figma, teacher testing workshop

V2 turned the paper prototype from the co-design workshop into something teachers could actually click through. The decisions made here stuck: the left to right pedagogical flow across three panels, the theming system including neon and high-contrast white, and the first real set of action and sense commands.

ORBIT V2 prototype V2 screen V2 screen V2 screen

Preview only. Selected screens shown.

Structured observation

Independent study, 2024

Evaluating this app in a real classroom needed an instrument that could hold context, not just counts. I built one around the critical incident technique, grounded in social constructivism and mapped using Sandoval’s conjecture mapping, so the data could carry the culture, the interactions, and the conditions students met the app under. Advised by Dr. Trevion Henderson, with David Zabner. If you’re doing co-design with teachers, or studying how autistic students meet new technology, I’d love to compare notes.

Structured observation poster Structured observation tool

Poster and instrument. Click through for the full documents.

Get in touch →

← Back to the shelf