Towards a Uniform User Interface
for Editing Data Shapes

Towards a Uniform User Interface for Editing Data Shapes

Abstract

Learning analytics can provide adaptive learning and performance support by analyzing user tracking logs. However, data-driven learning is usually confined to a specific context (e.g., learning English within one application), and thus not interoperable across systems or do-mains. In this paper, we investigate ways to improve integration of data across applications and educational domains, by means of Linked Data, using existing standards such as the Experience API. Using JSON-LD, existing Learning Record Store tools can be used to store the tracking logs, which are then interpreted and aligned as Linked Data. We have applied the solution in an initial data capture resulting in more than two million statements spanning two different applications. This way, we aim to enrich adaptive learning and performance support across contexts.

Keywords

Paper

Computer Assisted Language Learning (CALL) and other computer assisted learning systems enable automated tracking of Information about the Learning Process (i.e., learning analytics). Integration of learning analytics with Information about the Learner enriches data-driven learning. Learning analytics using user behavior and user’s background variables can improve adaptive computer assisted learning systems. The initial skill level of a new user can be predicted based on its background variables (e.g., age, location), and this level can be adjusted based on the user’s behavior (e.g., human computer interactions) throughout the learning trajectory. This improves learner engagement and lowers dropouts.

However, user tracking data usually resides in a closed context, i.e., within a specific application and confined to a single educational domain (e.g., learning English). By opening this data, i.e., integrating it across contexts, more learning analytics are available, and data-driven learning can be enriched.

Within the LEAPS project (LEarning analytics for AdaPtive Support, 2016-2018), we tackle the challenge of combining learning analytics across contexts and domains, and investigate ways to improve interoperability between computer assisted learning systems. This way, we aim to enrich adaptive learning systems. For example, within LEAPS, a first application provides auditory discrimination assessments, and a second provides relevant suggestions in writing exercises. The applications adapt the ability level based on the tracked behavior and the background variables of the user, based on the Elo-rating algorithm [1]. By combining learning analytics across these applications, both adaptive algorithms can be improved even further. For example, when the first application tracks that a user needs improvement for a specific auditory discrimination activity (e.g., distinguishing between “i” and “a”), related suggestions can be enabled within the second educational application. Therefore, interoperable data across applications is needed.

By means of Linked Data, we capture learning analytics in a common data model –- using the Resource Description Framework (RDF) [2] -– and thus enable interoperable data across applications. The main principles of Linked Data are: (i) use URIs as names for things; (ii) use HTTP URIs so that people can look up those names; (iii) when someone looks up a URI, provide useful information, using the standards; and (iv) include links to other URIs so that they can discover more things [3]. However, instead of requiring existing applications to adhere to these principles, our approach makes use of existing industry standards, and Linked Data is generated automatically. This eases the integration with existing industry workflows.

Our approach comprises two steps. The first step tracks user behavior using generic object models, interfaces, and standards. We make use of the Experience API (xAPI). xAPI is a technical specification that allows applications to dynamically track, store and share data about learners in their context building on a standardized tracking vocabulary and APIs for learning applications and reporting tools to communicate and exchange data. Thus, adopters can make use of existing specifications and implementations to already track user data within their own context. More detailed context information is stored using the Semantic ExeRcise Interchange Format (SERIF) [4]. This is a format for describing the content of educational assessments, based on the IMS QTI model from the IMS Global Learning Consortium. These xAPI statements can be logged using any compliant Learning Record Store. We make use of LearningLocker given its popularity and open license. The second step generates Linked Data out of the user tracking logs. As xAPI statements as logged in the JSON format, we can make use of JSON-LD to interpret the existing structure as RDF [5]. To define the common semantic meaning of these statements, we make use of an xAPI ontology and a SERIF ontology, uilding upon previous research, namely, TinCan2PROV [6]1. These ontologies define a common semantic meaning of these statements.

As this approach provides a common model across systems, the learning analytics can easily be integrated, on the one hand, with Information about the Learner, and on the other hand, with learning analytics across contexts, thus paving the way for transdisciplinary learning analytics. For example, we can then differentiate between learners that have difficulties learning foreign languages in general, or have troubles with one specific language. To integrate learning analytics across contexts, on the one hand, users need to be uniquely identified across the applications. When a user has different accounts for different applications, a unification of those accounts is needed to combine the learning analytics per user. This can be done using, e.g., another data source that unifies the different user accounts. As we make use of Linked Data, this process is made easier by design, as Linked Data improves integration of multiple data sources. On the other hand, the abilities of the users also need to be aligned across contexts. In this case, an exact match between abilities is not always possible. For example, distinguishing between the “i” and “a” sounds can be related, but not equal to being able to correctly write words containing “i” and “a”. For this, semantic models exist –- such as the Simple Knowledge Organization System [7] – that can relate concepts without unifying them. Based on their relatedness, learning analytics can be more or less combined.

Our approach is implemented in two educational applications and tested in multiple schools, resulting in more than two million statements that track user behavior. This initial data gathering is currently used to improve the existing adaptive learning algorithms, and allow an initial evaluation of combining learning analytics across contexts. Future work includes tracking a third educational application and combining transdisciplinary learning analytics. We foresee that this integration can improve personalization (e.g., adaptive learning) and performance support.

  1. xAPI used to be named the TinCan API.