Process Pad: a multimedia multi-touch learning platform

Home

Publications

Papers or book chapters

Title:

Process Pad: a multimedia multi-touch learning platform

Authors:

Kim, J., Meltzer, C., Salehi, S. & Blikstein, P.

Keywords:

Venue:

ITS 2011

Year:

2011

Type:

Refereed Conference Paper/Poster/Demo (with Proceedings)

doi:

10.1145/2076354.2076411

ACM Digital Library Page

Abstract:

This paper introduces Process Pad, an interactive, low-cost multi-touch tabletop platform designed to capture students' thought process and facilitate their explanations. The goal of Process Pad is to elicit students' think-aloud narratives that would otherwise be tacit, in other words, "learn to explain," and "explain to learn." Our focus is on identifying and understanding key design factors in creating opportunities for students to externalize and represent their mental models using multimodal data. From our user observations, we gleaned four design principles as essential criteria based upon which we refined our design: flexibility, tangibility, collaboration and affordability.

APA Citation:

Jain Kim, Colin Meltzer, Shima Salehi, and Paulo Blikstein. 2011. Process Pad: a multimedia multi-touch learning platform. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (ITS '11). ACM, New York, NY, USA, 272-273.

Publications

Author:

Keywords:

Year	Title	Venue	Focus
under review	Computational alchemy via representational magic: epistemic affordances of re-presenting complex scientific phenomena Blikstein, P.	JLS	Bifocal Modeling
under review	Programming pluralism: using learning analytics to detect patterns in novices' learning of computer programming Blikstein, P., Worsley, M., Piech, C., Sahami, M., Cooper, S. & Koller, D. computer science education, machine learning, process mining	JLS	Multimodal Learning Analytics
in press	Eye tracking analysis of visual spatial engineering games Gomes, J. S., Yassine, M., Worsley, M. & Blikstein, P eye tracking, online games, spatial ability, visual imagery	EDM	Multimodal Learning Analytics
in press	Learning to paraphrase: using paraphrase detection of spoken utterances to predict learner expertise Worsley, M. & Blikstein P. engineering education, machine learning, natural language	AERA	Multimodal Learning Analytics
in press	New technologies for learning and the future of public education in Brazil Blikstein, P.
in press	Student coding styles as predictors of help-seeking behavior Bumbacher E., Sandes A., Deutsch A., & Blikstein P. computer science education, machine learning	AIED	Multimodal Learning Analytics
in press	Supporting collaborative learning of probabilities with a tangible user interface: Design and preliminary results Schneider, B. & Blikstein, P. collaborative learning, probability, tabletop, tangible user interface	AERA	Combinatorix
in press	Towards the Development of Multimodal Action Based Assessment Worsley, M. & Blikstein P. computer vision, gesture recognition, machine learning, sequence mining	LAK	Multimodal Learning Analytics
2013	BeatTable: a tangible approach to rhythms and ratios Bumbacher E., Deutsch A., Otero N., & Blikstein P. knowledge-representation, mathematics education, music education, physical computing, tangible user interface	IDC
2013	The effect of Bifocal Modeling on students’ assessment of credibility Salehi, S., Fuhrmann, T., Greene, D., & Blikstein, P.	AERA	Bifocal Modeling
2013	Digital Fabrication and ‘Making’ in Education: The Democratization of Invention Blikstein, P. constructionism, digital fabrication, invention, making	FabLab Book	FabLab@School
2013	Multimodal learning analytics Blikstein, P.	LAK	Multimodal Learning Analytics
2013	NetLogo: teaching with turtles and crossing curricular boundaries (abstract only) Stonedahl, F., Weintrop, D., Blikstein, P. & Shannon, C.	SIGCSE
2013	Preparing for future learning with a tangible user interface: the case of neuroscience Schneider B., Wallace J., Pea, R. & Blikstein P. neuroscience, pen-based interface, tabletop, tangible user interface	IEEE TLT
2012	A framework for characterizing student changes in student identity during constructionist learning activities Worsley, M. & Blikstein P. engagement, engineering education, identity, motivation	Constructionism	Multimodal Learning Analytics
2012	An eye for detail: techniques for using eye tracker data to explore learning in computer-mediated environments Worsley, M. & Blikstein P. agent-based modeling, machine learning, process mining, sequence mining	ICLS	Multimodal Learning Analytics
2012	Bifocal Biology: Combining physical and virtual labs to support inquiry in biological systems Fuhrmann, T., Greene, D., Salehi, S., & Blikstein, P.	ICLS	Bifocal Modeling
2012	Bifocal Biology: the link between real and virtual experiments Fuhrmann, T., Greene, D., Salehi, S., & Blikstein, P.	Constructionism	Bifocal Modeling
2012	Bifocal biology: using bifocal modeling to support inquiry into real and ideal systems Fuhrmann, T., Greene, D., Salehi, S. & Blikstein, P epistemology, inquiry learning, modeling		Bifocal Modeling
2012	Bifocal Modeling workshop Blikstein, P., Fuhrmann, T., Greene, D., & Salehi, S.	ICLS	Bifocal Modeling
2012	Bifocal modeling: a study on the learning outcomes of comparing physical and computational models linked in real time Blikstein, P.	ICMI	Bifocal Modeling
2012	Bifocal Modeling: Combining real and virtual models for science learning in a school setting Blikstein, P., Greene, D., Furhmann, T., & Salehi, S.	IDC	Bifocal Modeling
2012	Bifocal modeling: mixing real and virtual labs for advanced science learning Blikstein, P., Fuhrmann, T., Greene, D. & Salehi, S.	IDC	Bifocal Modeling
2012	BrainExplorer: an innovative tool for teaching neuroscience Schneider, B., Wallace, J., Pea, R. & Blikstein, P. neuroscience, tabletop, tangible user interface	ITS
2012	Building (timely) bridges between learning analytics, educational data mining and core learning sciences perspectives Blikstein, P.	ICLS
2012	Combinatorix: a tangible user interface that supports collaborative learning of probabilities Schneider, B., Blikstein, P. & Mackay, W. collaborative learning, probability, tabletop, tangible user interface	ITS	Combinatorix
2012	Comparing the effect of interactive tabletops and desktops on students' cognition Salehi, S., Schneider, B. & Blikstein, P.	ITS
2012	MagneTracks: A Tangible Constructionist Toolkit for Newtonian physics Miller, A., Rosenbaum, C. & Blikstein, P.	TEI	Magnetracks
2012	Modeling How Students Learn to Program Piech, C., Sahami, M., Koller, D., Cooper, S. & Blikstein, P.	SIGCSE
2012	Multimodal Learning Analytics: enabling the future of learning through multimodal data analysis and interfaces Worsley, M. human dynamics, machine learning, natural language	ICMI	Multimodal Learning Analytics
2012	OpenGesture: a low-cost, easy-to-author application framework for collaborative, gesture-, and speech-based learning applications Worsley, M. & Blikstein P. collaborative learning, gesture recognition, multimodal, open microphone, open source, speech analysis and recognition	AERA	Multimodal Learning Analytics
2012	Process pad: a low-cost multi-touch platform to facilitate multimodal documentation of complex learning Salehi, S., Kim, J., Meltzer, C. & Blikstein, P.	TEI
2012	Process Pad: learning to explain, explaining to learn Salehi, S., Kim, J., Meltzer, C. & Blikstein, P.	TEI
2012	Re-presenting complex scientific phenomena using agent-based modeling in engineering education Blikstein, P.	ICLS
2012	The cognition of everyday machines: computational literacy and the development of everyday technological understanding Blikstein, P. & Greene, D assessment, computational literacy, technology education	AERA
2012	The making of minds: digital fabrication and the future of stem education Blikstein, P.	AERA
2012	UltraLite Collaboration: a low-cost toolkit to promote collaborative learning in the classroom Rosenbaum, C., Blikstein, P., Roschelle, J. & Schank, P.	ICLS
2012	Using automatic logging and machine learning to uncover hidden patterns in learning to program Blikstein, P. & Worsley, M. computer science education, machine learning	ICLS	Multimodal Learning Analytics
2012	Using dynamic time warping and cluster analysis to analyze the learning of computer programming Blikstein, P., Safdari. M. & Worsley, M. computer science education, machine learning	AERA & ICLS	Multimodal Learning Analytics
2012	Using learning analytics and educational data mining to understand scripted and exploratory learning environments: toward a common theoretical and methodological framework to investigate the trajectory to expertise Blikstein, P.	AERA
2011	Collaboration through documentation: automated capturing of tangible constructions to support engineering design Tseng, T., Bryant, C. & Blikstein, P.	IDC
2011	Computing what the eye cannot see: educational data mining, learning analytics and computational techniques for detecting and evaluating learning Blikstein, P. & Worsley, M. computer science education, machine learning	AERA	Cognition of Construction Multimodal Learning Analytics
2011	Towards the identification of emergent strategies for interdependent collaboration in complex tasks Greene, D. & Blikstein, P. collaborative learning, robotics	CSCL
2011	Learning analytics: assessing constructionist learning using machine learning Blikstein, P. & Worsley, M.		Multimodal Learning Analytics
2011	LightUp: a low-cost, multi-age toolkit for learning and prototyping electronics Asgar, Z., Chan, J., Liu, C. & Blikstein, P. electronics, interaction design, tangibles, toolkits	IDC	LightUp
2011	Mechanix: an interactive display for exploring engineering design through a tangible interface Tseng, T., Bryant, C. & Blikstein, P.	TEI
2011	OpenGesture: a low-cost authoring framework for gesture and speech based application development and learning analytics Worsley, M., Johnston, M. & Blikstein, P. gesture recognition, multimodal, open microphone, speech analysis and recognition	IDC	Multimodal Learning Analytics
2011	Osciloscopiando: interactive video-mechanical sculpture Steinsapir, D. & Blikstein, P.	TEI
2011	Process Pad: a multimedia multi-touch learning platform Kim, J., Meltzer, C., Salehi, S. & Blikstein, P. learning environment, multitouch	ITS
2011	QWERTY and the art of designing microcontrollers for children Blikstein, P. & Sipitakiat, S. microcontrollers, robotics	IDC
2011	Teaching interaction design & children within diverse disciplinary curricula Gilutz, S., Bekker, T., Fisch, S. & Blikstein, P.	IDC
2011	Using learning analytics to assess students' behavior in open-ended programming tasks Blikstein, P.	LAK
2011	Using machine learning to examine learner's engineering expertise using speech, text, and sketch analysis Worsley, M. & Blikstein, P. drawing analysis, natural language, STEM	JPS	Multimodal Learning Analytics
2011	What’s an Expert? Using learning analytics to identify emergent markers of expertise through automated speech, sentiment and sketch analysis Worsley, M. & Blikstein, P. assessment, expert, learning analytics, multimodal, speech analysis and recognition	EDM & HSTAR-Cicero	Multimodal Learning Analytics
2010	A new age in digital tangible interfaces for learning Blikstein, P.	ICLS
2010	Using Agent-Based Computer Modeling to simulate the use of multiple epistemological resources in the classroom Blikstein, P.	CogSci
2010	Can non-intelligent behavior generate intelligence? Multi-agent computational modeling as a theory-building tool in developmental psychology and education research Blikstein, P.	JPS
2010	Changing schools, one laser cutter at a time Blikstein, P.	FAB	FabLab@School
2010	Connecting the science classroom and tangible interfaces: the Bifocal Modeling framework Blikstein, P.	ICLS	Bifocal Modeling
2010	Constructionism and the next 40 years Blikstein, P.	Constructionism
2010	Data mining automated logs of students' interactions with a programming environment: a new methodological tool for the assessment of constructionist learning Blikstein, P.	AERA
2010	Learning analytics - natural assessments for constructionist learning environments Worsley, M. & Blikstein, P. assessment, machine learning, natural language	HSTAR-Cicero	Multimodal Learning Analytics
2010	MaterialSim: an agent-based learning environment for advanced scientific content Blikstein, P. & Wilensky, U.
2010	Multimodal interactive spaces: MagicTV and MagicMAP Worsley, M. & Johnston, M. gesture recognition, multimodal, open microphone, speech analysis and recognition	IEEE	Multimodal Learning Analytics
2010	Programmable robotics and environmental sensing for low-income populations: design principles, impact, and technology Sipitakiat, A. & Blikstein, P.	ICLS
2010	Robotics and environmental sensing for low-income populations: design principles, impact, technology, and results Sipitakiat, A. & Blikstein, P.	ICLS
2010	Ten Constructionists Under Construction: visions for a new age in constructionist learning Blikstein, P.	Constructionism
2010	The Treachery of Representation: The cognitive impact of exposed representational elements in students' explanations of complex scientific phenomena Blikstein, P.	ASEE
2010	Think globally, build locally: a technological platform for low-cost, open-source, locally-assembled programmable bricks for education Sipitakiat, A. & Blikstein, P.	TEI
2010	Toward the development of learning analytics: student speech as an automatic and natural form of assessment Worsley, M. & Blikstein P. drawing analysis, machine learning, multimodal, natural language, speech analysis and recognition	AERA	Multimodal Learning Analytics
2009	An atom is known by the company it keeps: constructing multi-agent models in engineering education Blikstein, P. & Wilensky, U. engineering education	IJCML
2008	Complex systems and learning: empirical research, issues, and "seeing" scientific knowledge with new eyes Jacobson, M.J., So, H.-J., Lee, J., Wilensky, U., Blikstein, P., Sengupta, P., Levy, S.T. & Noss, R.	ICLS
2008	Computer modeling methodologies for investigating classroom practices and individual cognition Blikstein, P.
2008	Computer modeling methodologies for investigating classroom practices and individual cognition Blikstein, P.	MMER
2008	Designing for ubiquitous robot learning activities with the GoGo board Sipitakiat, A. & Blikstein, P.	ICESIT	GoGoBoard
2008	GoGoBot: group collaboration, multi-agent modeling, and robots Rand, W., Blikstein, P. & Wilensky, U.	AAMAS
2008	Groupwork as a complex adaptive system: a methodology to model understand and design classroom strategies for collaborative learning Blikstein, P., Abrahamson, D. & Wilensky, U.	AERA
2008	Implementing Multi-Agent Modeling in the Classroom: Lessons from Empirical Studies in Undergraduate Engineering Education Blikstein, P. & Wilensky, U.	ICLS
2008	The classroom as a complex adaptive system: an agent-based framework to investigate students' emergent collective behaviors Blikstein, P., Abrahamson, D. & Wilensky, U.	ICLS
2008	Travels in Troy with Freire: technology as an agent of emancipation Blikstein, P.
2007	Examining group behavior and collaboration using Agent-Based Modeling and robots Blikstein, P., Rand, W. & Wilensky, U.	Agent
2007	Agent-based modeling in education: atoms, neurons, and agents Blikstein, P. & Wilensky, U.	DLAC
2007	An empirical study of a complex systems approach to undergraduate engineering curricula through the construction of agent-based models Blikstein, P. & Wilensky, U.	EARLI
2007	Bifocal modeling: a framework for combining computer modeling, robotics and real-world sensing Blikstein, P. & Wilensky, U.	AERA	Bifocal Modeling
2007	Bridging the gap between neuroscience and qualitative methods: “glass boxing” computational cognitive simulation using agent-based modeling Blikstein, P. & Wilensky, U.	JPS
2007	Classroom model, model classroom: Computer-supported methodology for investigating collaborative-learning pedagogy Abrahamson, D., Blikstein, P. & Wilensky, U.	CSCL
2007	Just a cog in the machine: participatory robotics as a tool for understanding collaborative learning and decision-making Blikstein, P., Rand, W. & Wilensky, U.	CSCL
2007	Modeling Manifold Epistemological Stances with Agent-Based Computer Simulation Blikstein, P. & Wilensky, U.	AERA
2007	Multi-Agent Simulations as a Tool for Investigating Cognitive-Developmental Theory Blikstein, P., Abrahamson, D. & Wilensky, U.	AERA
2007	New technologies in environmental education: changing the way we teach and learn in schools (“As novas tecnologias na educação ambiental: instrumentos para mudar o jeito de ensinar e aprender na escola”) Blikstein, P.
2007	Reflections on the Feasibility of Technology as a Freirean Emancipatory Tool in Learning Environments Blikstein, P.	AERA
2007	Using complex systems to design and model learning environments for advanced scientific content Blikstein, P. & Wilensky, U.	ICTMA
2006	A case study of multi-agent-based simulation in undergraduate materials science education Blikstein, P. & Wilensky, U.	ASEE
2006	Assessment and its discontents (“Mal-estar na avaliação”) Blikstein, P.
2006	From inert to generative modeling: case studies of multi-agent-based simulation in undergraduate engineering education Blikstein, P. & Wilensky, U.	AERA
2006	Learning About Learning: Using Multi-Agent Computer Simulation to Investigate Human Cognition Blikstein, P. & Wilensky, U.	ICCS
2006	MaterialSim: A constructionist computer-based modeling environment for materials science learning Blikstein, P. & Wilensky, U.	MS&T
2006	Minsky, Mind, and Models: Juxtaposing Agent-Based Computer Simulations and Clinical-Interview Data as a Methodology for Investigating Cognitive-Developmental Theory Blikstein, P., Abrahamson, D. & Wilensky, U.	JPS
2006	Participatory, embodied, multi-agent simulation Blikstein, P., Rand, W. & Wilensky, U.	AAMAS
2006	The missing link: A case study of sensing-and-modeling toolkits for constructionist scientific investigation Blikstein, P. & Wilensky, U.	ICALT
2006	A Technological Platform for Trans-Media Scientific Exploration Blikstein, P. & Wilensky, U.	IDC
2006	Widgets, planets, and demons: the case for the integration of human, embedded, and virtual agents via mediation Rand, W., Blikstein, P. & Wilensky, U.	SwarmFest
2006	‘Hybrid Modeling’: advanced scientific investigations linking computer models and real-world sensing Blikstein, P. & Wilensky, U.	ICLS	Bifocal Modeling
2005	Less is More: Agent-Based Simulation as a Powerful Learning Tool in Materials Science Blikstein, P. & Wilensky, U.	AAMAS
2005	Mixed-media learning environments Abrahamson, D., Blikstein, P., Lamberty, K. K. & Wilensky, U.	IDC
2005	NetLogo: Where We Are, Where We’re Going Blikstein, P., Abrahamson, D. & Wilensky, U.	IDC
2004	GoGo Board: Augmenting Programmable Bricks for Economically Challenged Audiences Sipitakiat, A., Blikstein, P. & Cavallo, D.	ICLS	GoGoBoard
2004	MaterialSim: an agent-based simulation toolkit for Materials Science learning Blikstein, P. & Wilensky, U.	ICEE
2004	The city that we want: generative themes, constructionist technologies and school/social change Cavallo, D., Blikstein, P., Sipitakiat, A., Basu, A., Camargo, A., de Deus Lopes, R. & Cavallo, A.	ICALT
2004	The mermaids of electronic teaching (“As sereias do ensino eletrônico”) Blikstein, P. & Zuffo, M. K.
2003	God hides in the details: design and implementation of technology-enabled learning environments in public education Blikstein, P. & Cavallo, D.	EuroLogo
2003	GoGo board: low-cost, programmable and reconfigurable robotics Sipitakiat, A., Blikstein, P. & Cavallo, D.		GoGoBoard
2002	Technology as a Trojan Horse in School Environments: The Emergence of the Learning Atmosphere (II) Blikstein, P. & Cavallo, D.	ICL
2002	Technology as a Trojan Horse in School Environments (I) Blikstein, P. & Cavallo, D.	Unesco SIMPLaC
2002	The GoGo Board: moving towards highly available computational tools in learning environments Sipitakiat, A., Blikstein, P. & Cavallo, D.	ICL
1999	Comparison between grain size from Monte Carlo simulation and Silicon Steel annealing Blikstein, P., Takanohashi, R., Landgraf, F. J. G. & Tschiptschin, A. P.	ABM	Bifocal Modeling
1999	Comparison of grain sizes of silicon steels obtained experimentally and using the Monte Carlo method (“Comparação entre tamanhos de grãos obtidos por simulação pelo método de Monte Carlo e resultantes de recozimento de aço Si”) Blikstein, P., Takanohashi, R., Landgraf, F. J. G. & Tschiptschin, A. P.	ABM	Bifocal Modeling
1999	Monte Carlo simulation of grain growth (II) Blikstein, P. & Tschiptschin, A. P.		Bifocal Modeling
1998	Monte Carlo simulation of grain growth (I) Blikstein, P. & Tschiptschin, A. P.	IASTED	Bifocal Modeling
1998	Simulação computacional de crescimento de grão pelo método de Monte Carlo Blikstein, P. & Tschiptschin, André P.		Bifocal Modeling
1997	Computer simulation of grain growth using the Monte Carlo Method Blikstein, P. & Tschiptschin, A.P.	ABM	Bifocal Modeling

Publications

Connect with us