EUR-Lex Access to European Union law

Back to EUR-Lex homepage

This document is an excerpt from the EUR-Lex website

Document 52013SC0341

COMMISSION STAFF WORKING DOCUMENT Analysis and mapping of innovative teaching and learning for all through new Technologies and Open Educational Resources in Europe Accompanying the document Communication 'Opening Up Education'

/* SWD/2013/0341 final */

52013SC0341

COMMISSION STAFF WORKING DOCUMENT Analysis and mapping of innovative teaching and learning for all through new Technologies and Open Educational Resources in Europe Accompanying the document Communication 'Opening Up Education' /* SWD/2013/0341 final */


Contents

1....... Introduction. 5

1.1.... Future trends opening up education: personalisation, collaboration, blended learning. 6

1.2.... New technologies and OER can enable a paradigm shift 8

1.3.... The objectives of the Staff Working Document 10

2....... The State of Play in the EU: a major implementation Gap and Barriers for uptake. 12

2.1.... The opinion of stakeholders: results of the public consultation. 13

2.2.... Major implementation gap in education. 14

2.3.... The underlying problem drivers. 17

          2.3.1.    Open and innovative learning environments. 18

          2.3.2.    Open Educational Resources challenging education. 30

          2.3.3.    ICT infrastructures and equipment stay a recurrent issue to tackle. 40

3....... Consequences  for the EU.. 46

3.1.... Lack of digital competences for employability. 46

3.2.... Digital divide and access to knowledge. 47

3.3.... Inefficient use of resources. 49

3.4.... Losing worldwide leadership. 51

4....... Ways forward for systemic innovation: examples of best practices. 52

4.1.... One-to-one learning initiatives in Europe 52

4.2.... eTwinning – A European wide community for schools. 56

4.3.... Large-scale policy experimentations. 59

4.4.... Open Courseware. 61

4.5.... MOOCs are changing higher education. 63

4.6.... Large-scale platforms for open education. 68

5....... Concluding remarks: conditions for sustainability, scalability and impact 70

List of acronyms. 73

List of Figures. 75

List of Boxes. 76

List of Examples. 76

Executive Summary

This Staff Working Document accompanies the new European initiative on 'Opening up Education'. It outlines the scope, size and complexity of the challenges that lie ahead, in order to modernize and open up education through new technologies and Open Educational Resources (OER). The document provides the necessary evidence and background analysis on the use of new technologies and OER in education and training across Europe. It is based on in-depth country analysis for all EU Member States, expert reports and an extensive literature review on the state of play for new technologies and open educational resources in education and training.

What is the state of play in Europe? New technologies and OER can have an extraordinary effect on improving the efficiency, accessibility and equity of education, training and learning. Learning and teaching can become more focused on the learner supporting the individual learning pathways, enhancing collaboration online and blending formal and informal education. Personalisation, collaboration and links between formal and informal learning enhanced by technologies will be at the core of future learning and push educational institutions towards opening education and institutional transformation.

However, literature and practices show that education is one of the last societal sectors in Europe, which has not yet embedded the potential of new technologies, failing to provide European citizens with the skills necessary for the future. Europe is not fully reaping the potential offered by new technologies and the upsurge across the globe of digital content, including OER, to improve the efficiency, accessibility and equity of its education, training and learning systems. 63% of nine year olds do not study at a highly digital equipped school and only 20 to 25% of students are taught by digital confident and supportive teachers.

In a digital world, this has serious consequences for citizens who do not possess the skills necessary for social and economic well-being. In the last years the lack of systemic uptake of new technologies in education has been a concern for many EU countries but with scattered efforts. Despite the investments, a full uptake of new technologies and OER requires more than dispersed action. Evidence indicates that the EU-wide experiences on innovative learning need to be scaled up into all classrooms, reach all learners and teachers/trainers at all levels of education and training.

What are the underlying problem drivers of this implementation gap?

· Teaching and learning environments: lack of teachers' skills for a real digital pedagogy; organisational barriers for developing innovative and personalised pedagogies and assessment practices; and lack of validation and recognition mechanisms for online-acquired skills.

· Digital contents: insufficient supply of quality digital contents across languages subjects and needs; uncertain legal framework conditions for producing, using, re-using and sharing educational contents; and difficult access to relevant, quality digital resources, in particular OER.

· ICT infrastructure and equipment: uneven availability of ICT infrastructures and tools, including connectivity, across Member States, and absence of open interoperability standards.

What are the consequences for the EU? Without adequate action in the EU, the current problems of uneven availability of infrastructures, difficult discoverability of quality digital resources, difficult validation of skills acquired online, etc. will continue to be reproduced. This has negative implications related to digital skills, digital divide and access to knowledge, inefficient use of resources and Europe's leadership.

Education and training systems do not provide the digital competences needed in the 21st century economy and society. Europe will not provide similar opportunities to all its citizens to acquire digital skills for employability as well as active citizenship. The European economy would keep on facing digital skills gaps.

There is a risk of increasing the digital divide between digital competent people and those who do not have such ICT skills. This is particularly relevant in terms of access to knowledge. The current gaps between countries may increase even more. Some countries would continue to make efforts for exploiting the potential of digital technologies for learning, while others would reduce or even stop them. This is likely to increase the negative impacts in terms of social cohesion, competitiveness and efficiency of resources.

The efficiency potential of new technologies, evident in all economic sectors, is not reaped off in education and training, which lead to an inefficient use of educational resources. Europe will not be able to catch up with the emerging digital phenomena in education and training across the world and be able to modernise its education systems in terms of equity, quality and efficiency.

Europe will be lagging behind in terms of supply of OER and emerging digital markets compared to the US and Asia. Third countries will lead the emerging digital phenomena in the education and training field (e.g. MOOC) and better exploit the potential of new technologies and of the investments already done. The EU would be just a follower, losing opportunities and increasing its dependency on educational technologies designed and produced abroad.

What are possible ways forward? Education and training systems must be lined up with the expectations and requirements of the digital society. New technologies and the increasing attention for open educational resources can enable a paradigm shift and transform education if it takes account simultaneously of pedagogical, organisational and technological innovation. Education will only reap the full benefits of embedding new technologies and open educational resources when it opens up simultaneously the learning environments, the content and knowledge and the underlying infrastructures. The focus has to be on the learner and improvement of learning, instead of focusing on technology only.

The new ways of looking to learning through OER (and MOOCS) require a rethinking of the educational landscape in terms of access, quality and efficiency. Past experiences have shown that any initiative to overcome the implementation gap of using new technologies in education requires a 360 degree approach or (eco) system-wide, and not a piecemeal approach. A full uptake of new technologies and OER requires more than boosting experimentations across Europe.

Over the past years several large scale pilots have been implemented across Europe, crossing national countries and some even of European dimension. Various practices in Europe are being looked into such as: One-to-one learning initiatives providing every child or teacher with a personal device; eTwinning, a European-wide community of schools; large scale experimentations providing real-life laboratories of scale to develop and test scenario's for mainstreaming innovative use of new technologies in education; Open Courseware; MOOCs changing the European higher education landscape and large-scale platforms for open education.

Based on the evidence base and best practices provided in this Staff Working Document the underlying conditions and some ways forward for successful uptake and use of new technologies and OER in education are analysed.

1.         Introduction

Highlights New technologies and open educational resources (OER) can have an extraordinary effect on improving the efficiency, accessibility and equity of education, training and learning. Learning and teaching can become more focused on the learner supporting the individual learning pathways, enhancing collaboration online and blending formal and informal education. Personalisation, collaboration and links between formal and informal learning enhanced by technologies will be at the core of future learning and push educational institutions towards opening education and institutional transformation. However, literature and practices show that education is one of the last societal sectors in Europe, which has not yet embedded the potential of new technologies, failing to provide European citizens with the skills necessary for the future. In the last years the lack of systemic uptake of new technologies in education has been a concern for many EU countries but with scattered efforts. Despite the investments, a full uptake of new technologies and OER requires more than dispersed action. Evidence indicates that the EU-wide experiences on innovative learning need to be scaled up into all classrooms, reach all learners and teachers/trainers at all levels of education and training. Education and training systems must be lined up with the expectations and requirements of the digital society. New technologies and the increasing attention for OER can enable a paradigm shift and transform education if it takes account simultaneously of pedagogical, organisational and technological innovation. Education will only reap the full benefits of embedding new technologies and OER when it opens up simultaneously the learning environments, the content and knowledge and the underlying infrastructures. The focus has to be on the learner and improvement of learning, instead of focusing on technology only.

We are living a paradox: digital technologies are fully embedded in our economies and societies – they have, for example, changed the way people may access financial services or read the news – but they have not yet changed the way learning and teaching occurs in European schools, training institutions or universities.

The European education and training systems have not yet fully tapped into the potential offered by digital technologies and content, including open educational resources (OER)[1], losing the opportunity to innovate the teaching and learning practices, to increase the efficiency and equity of the education and training provision and to raise the digital skills of learners necessary for a more competitive and knowledge-based economy.

Integration of digital technologies and digital content in education and training systems does not simply mean more electronic devices or more broadband connections. Supporting learning with technologies allows for the combination of innovative pedagogies with an effective use of digital tools and content which in turn can boost the quality of teaching and learning processes.

1.1.        Future trends opening up education: personalisation, collaboration, blended learning

Digital competences are considered core skills for employability and societal inclusion due to both fast advances in technology and structural changes of European labour markets related to demographic change, globalisation and immigration. These transversal skills gain importance[2] as they empower lifelong learners who respond to changes flexibly, develop competences pro-actively and thrive in collaborative learning and working environments.

Box 1: A few ideas about the future

Constants amongst the change[3] 1. The world of work is increasingly global and increasingly collaborative. 2. People expect to work, learn, socialise, and play whenever and wherever they want to. 3. The Internet is becoming a global mobile network — and already is at its edges. 4. The technologies we use are increasingly cloud-based and delivered over utility networks, facilitating the rapid growth of online videos and rich media. 5. Openness — concepts like open content, open data, and open resources, along with notions of transparency and easy access to data and information — is moving from a trend to a value for much of the world. 6. Legal notions of ownership and privacy lag behind the practices common in society. 7. Real challenges of access, efficiency, and scale are redefining what we mean by quality and success. 8. The Internet is constantly challenging us to rethink learning and education, while refining our notion of literacy. 9. There is a rise in informal learning as individual needs are redefining schools, universities, and training. 10. Business models across the education ecosystem are changing. Ten future technological trends[4] 1. e-Books: dynamic formats, and innovative uses 2. Publisher-led short courses: offering self-directed, CPD learning opportunities; 3. Assessment for Learning: changing the focus of assessment from assessment of learning outcomes towards assessment for feedback to enhance the learning; 4. Badges: awarding ‘non-formal learning’ through a widely-recognised honour or badge system; 5. MOOCs: massive open online courses bring open-access education to the masses; 6. Changing nature of academic publishing: the continued development of open-access scholarly publishing initiatives; 7. Seamless Learning: learning across multiple locations, platforms, formats in a continued way; 8. Learning Analytics: emphasis on obtaining data to learn more about the learner and their contexts in an effort to improve learning opportunities; 9. Personal Inquiry Learning: focus on the learner as an active, exploratory learning agent involved in discovery and inquiry learning processes; 10.  Rhizomatic Learning: learning occurring through multi-facets/avenues of inquiry, taking contexts and previous knowledge and experiences into consideration, using social and personal sources of learning to foster a personal learning network.

Recent forward-looking surveys on ICT and education (Horizon Report 2013[5]; IPTS 2011[6]; Sharples 2012[7]; Matel Project 2013[8]) all identify an increasing opening up in education of practices, resources and infrastructures. They underline the core trends:

· Personalisation both in terms of equity among all learners[9] as well as in terms of individual learning plans and tailor-made learning activities. A mix of different technologies can support personalisation, by allowing for a diversity of learning activities, tools and materials; providing tools which support continuous monitoring and assessment strategies; making educational resources openly available; allowing for the implementation of collaborative projects; offering learning opportunities that are motivating, engaging and even playful; and supporting multilingual environments.  

· Collaboration: Collaboration with the community at large, and with people from other social, cultural or age groups, will become increasingly important. Virtual study exchange programmes, internet based intercultural exchange projects, online massive multiplayer games, simulations creating and sharing open educational resources with peers  and other internet-based services can serve educational institutions in allowing learners to experience, understand and reflect upon societal developments in a safe and protected environment.

· Blending formal and informal learning: abundant learning opportunities that assist people in converting professional experiences and personal skills into competences that are relevant for (new) job profiles. However, not all of these training opportunities will lead to formally recognised qualifications. Similarly, professional experiences acquired in previous jobs will give rise to a number of diverse competences that are seldom officially acknowledged or recognised. Thus, in view of increasing labour market dynamics, informally acquired skills need to become better recognised and/or integrated with formal qualifications and mechanisms will have to be put in place that allow people to obtain formal recognition for their experiences and skills.

Figure 1: Conceptual map of the future of learning[10]

Personalisation, collaboration and links between formal and informal learning will be at the core of future learning and push educational institutions towards opening education and institutional transformation[11]. They will be the central guiding principles for organising education in the future. Together with scalable and flexible infrastructure (e.g. cloud-based) and proliferation of (personal) mobile devices access to learning becomes practically unlimited.

1.2.        New technologies and OER can enable a paradigm shift

All forecast surveys note a also fundamental paradigm shift on the role of new technologies supporting educational change: while some years ago the term "e-learning" dominated the educational discourse, the "e" has nowadays disappeared. It is all about the core business of education: learning. The focus is no longer on ICT tools and infrastructures but on open and flexible learning and teaching with the learner (and the educator) at the centre, enhanced through new technologies. This indicates that the step from an early adoption of ICT use in education towards mainstreaming has been started. 

Transforming education requires pedagogical, organisational and technological innovation[12]. Learning takes place in a learning environment which is increasingly open and flexible to embed a diversity of learning and teaching practices and respond to the personalised needs of each learner. Such a learning environment can be a local classroom or college setting or based anywhere remotely between peer learners and educators. In order to acquire knowledge and thus to learn, content is provided through digital educational resources (openly available or not) and offered through courses in a learning environment guided by a teacher or tutor. One of the basic conditions enabling learning practices are the available ICT infrastructures, tools and networks.

Figure 2: An integrated vision and approach

a. Learning and teaching in Open Learning Environments: New technologies are encouraging teaching and learning based on personalisation and collaboration, changing and redefining the roles of teachers and learners. The increasing use of social media makes learning environments more dynamic, flexible and open, taking into account that learning also takes place outside formal learning environments, i.e. at home, in the community, at work, for leisure, in informal ways. Learning and teaching in the 21st century are increasingly taking place through learning networks and communities of practices, connected and collaborating, even if geographically dispersed, through open technologies. Learning networks promote collaboration across borders, language barriers and institutional walls. For teachers and educators, specifically communities of practice are an ideal platform for collaborative peer learning, exchanging good practices and even developing joint teaching activities between educational institutions (e.g. via eTwinning[13]).

b. Acquiring knowledge through Open Educational Resources: Digitised materials offered freely and openly for educators, students and self-learners are not only driving change in the access to content for everyone but also widening its diversity and changing the educational practices. Re-use and sharing of open educational resources (OER) increase the quality, reduce the costs and the time lag between production and use of resources. Learning becomes more personalised, interactive and collaborative. Access to educational content and services anytime, anywhere and how the learner wishes opens opportunities for a diversity of learners, from those more exigent and ready to choose their education paths to those more difficult-to-reach such as those outside the traditional educational landscape and early school leavers.

c. Educational services enabled by ICT Infrastructures and connectivity: An open learning infrastructure will enable more effective and efficient ways to make use of that abundance. An open learning infrastructure relies on open standards that enable the interconnection between different infrastructures or the development of an integrated infrastructure from heterogeneous independently developed building blocks. Different services offering for example integration, visualisation and analytics can be built on these infrastructures allowing teachers and learners to leverage the abundance of learning content in much more flexible ways when these resources are integrated in more subtle ways in their existing workflows.[14]

This paradigm shift also indicates the importance of integrating all of these elements simultaneously and in a holistic way. Only then will education reach full uptake and reap the full benefits of embedding new technologies and OER in its practices.

1.3.        The objectives of the Staff Working Document

In the last years the lack of systemic uptake of ICT in education has been a concern for many EU countries. Member States are looking into the scalability and sustainability of their pilots in order to increase the uptake of ICT and OER in education. The focus is on the learner and improvement of learning, instead of focusing on technology only.

This Commission Staff Working Document aims at analysing and mapping the use of new technologies and Open Educational Resources in EU education and training. The Staff Working Document is based on i) in-depth country analyses of all EU Member States[15];  ii) extensive literature review on the state-of-the-art of ICT and OER in education and training; and iii) expert reports provided by DG JRC-IPTS[16].

The in-depth country analyses describe how the EU Member States have provided digital resources and integrated the use of ICT in education and their strategies, policies and initiatives. The evidence and the literature review highlight the importance of collection of data for evidence-based policy making both at EU and national level, particularly given the rapid changes in the supply, demand and distribution of educational content through digital technologies.

The country analyses draw on the experiences of the individual Member States and its publication[17] is one of the core outcomes from the Open Method of Coordination (OMC) Thematic Working Group on 'ICT and education' under the Education and Training 2020 Work Programme. It reflects on developments achieved by the Lifelong Learning (LLP) and FP7 programmes from 2006 until today – a period when the EU Member States invested heavily in the use of ICT for education and training.

The Commission also undertook a comprehensive consultation of external stakeholders, including a public consultation carried out between August and November 2012[18]. It was targeted to both individuals and public authorities and organisations involved in education and training (e.g. schools, universities, trade unions, industry and consumers associations). The aim was to assess i) to what extend stakeholders agreed with a possible initiative, its rationale and scope; ii) possible actions and; iii) the need for a policy intervention at EU level.

Further to the public consultation, four other initiatives were undertaken to collect the views of external stakeholders:

· The views of Member States have been discussed and analysed through the Thematic Working Group on 'ICT and Education'. This group is composed mainly by representatives of ministries of Education and the European Trade Union Committee for Education.

· The views of external experts and other stakeholders have been discussed and analysed through a High Level Experts Group. Participants were experts from international organisations; researchers involved in education, training and innovation; members of EU networks, representatives of industry and open universities, as well as developers of open educational resources.

· The Commission also met relevant stakeholders concerned by the initiative, both at ad hoc roundtables (i.e. European publishers; Digital Europe) and bilaterally, included ICT and publishing industry, representatives of education and training organisations, NGOs and public authorities.

· A Ministerial Conference entitled 'Opening up education through technologies' was organised on 9-11 December 2012 under the Cypriot Presidency (in collaboration with Norwegian authorities)[19]. Ministers discussed the scope and actions of the Opening up Education initiative and forwarded the outcome of their debate through Presidency Conclusions that highlighted the innovative potential of ICT in fundamentally transforming education and training. The Cypriot Presidency focused on the importance of up-scaling pilot programmes, the necessity to explore further how to enhance the use and sharing of OER, the need for accreditation and quality assurance mechanisms, the vital role of teachers and communities of practice, and the potential for transnational cooperation and peer learning in these areas.

2.         The State of Play in the EU: a major implementation Gap and Barriers for uptake

Highlights The European Commission undertook a comprehensive consultation of external stakeholders, including a public consultation carried out between August and November 2012[20]. Responses were very positive towards a possible initiative by the EU creating synergies and complementing existing or future actions by Member States. 84% of respondents found that ensuring a wider availability and use of ICT and OER in education should be a top priority for the EU and its Member States. The most important actions to be implemented were ensuring open access for educational resources developed with public funding; support for teacher education and professional development on ICT didactics and use of open educational resources; increased access to communities of practice; and adaptation of the funding and quality frameworks to incentivise engagement in open education. Literature and practices show that Europe is not fully reaping the potential offered by new technologies and the upsurge across the globe of digital content, including OER, to improve the efficiency, accessibility and equity of its education, training and learning systems. 63% of nine year olds do not study at a highly digital equipped school and only 20 to 25% of students are taught by digital confident and supportive teachers. In a digital world, this has serious consequences for citizens who do not possess the skills necessary for social and economic well-being. In the last years the lack of systemic uptake of new technologies in education has been a concern for many EU countries but with scattered efforts. The following underlying problem drivers have been identified causing this implementation gap: · Teaching and learning environments: lack of teachers' skills for a real digital pedagogy; organisational barriers for developing innovative and personalised pedagogies and assessment practices; and lack of validation and recognition mechanisms for online-acquired skills. · Digital contents: insufficient supply of quality digital contents across languages subjects and needs; uncertain legal framework conditions for producing, using, re-using and sharing educational contents; and difficult access to relevant, quality digital resources, in particular OER. · ICT infrastructure and equipment: uneven availability of ICT infrastructures and tools, including connectivity, across Member States, and absence of open interoperability standards. Despite the investments, a full uptake of new technologies and OER requires more than dispersed action. Evidence indicates that the EU-wide experiences on innovative learning need to be scaled up into all classrooms, reach all learners and teachers/trainers at all levels of education and training. Past experiences have shown that any initiative to overcome the implementation gap of using ICT in education requires a 360 degree approach or (eco) system-wide, and not a piecemeal approach. A full uptake of ICT and OER requires more than boosting experimentations across Europe.

This chapter will describe the current gap in Europe between the embedded use of digital technologies in almost all aspects of our lives and their poor integration in education and training.

As a starting point one can describe the core problem as follows:

Europe is not fully reaping the potential offered by new technologies and the upsurge across the globe of digital content, including open educational resources, to improve the efficiency, accessibility and equity of its education, training and learning systems.

Based on the description of the implementation gap in Europe, Chapter 2 will analyse the underlying reasons for this implementation gap and the obstacles to overcome it. These obstacles are manifold and will be discussed each in detail.

2.1.        The opinion of stakeholders: results of the public consultation

A total number of 222 responses were received, 80 of which representing organisations[21]. Responses were very positive towards all three above mentioned aspects. The main findings were:

· 84% of respondents found that ensuring a wider availability and use of ICT and OER in education should be a top priority for the EU and its Member States.

· Both organisations and individuals foresaw strong positive effects for almost all education and training sectors.

· A very strong agreement of stakeholders with the problems to be addressed: a deeper exploitation of OER would increase access to education (93%); the use of ICT and OER in education in Europe is still too fragmented (92%); pedagogical approaches for using ICT and OER are not sufficiently available to teachers, particularly during initial teacher training (87%).

· A strong support for EU intervention: 86% of respondents defended that an EU initiative would create synergies and complement existing or future actions by Member States; 81% disagreed that it would be appropriate to leave the initiative exclusively to Member States; 86% stated that jointly agreed actions are needed to maximise the effects.

· Among other problems to be addressed, the need for quality certification systems and standards was the most emphasised (24% of organisations and 18% of individuals have indicated so in an open question), followed by support to teachers and need to change mentalities (22% of individuals and 12% of organisations, also in an open question).

· The most important actions to be implemented were ensuring open access for educational resources developed with public funding; support for teacher education and professional development on ICT didactics and use of OER; increased access to communities of practice; and adaptation of the funding and quality frameworks to incentivise engagement in open education.

· Support for a future EU initiative.

Interesting to highlight are the underlying reasons for this implementation gap or obstacles identified in the public consultation (in order of importance):

· The use of OER and ICT in education in Europe is still too fragmented (92%);

· Deeper exploitation of OER would increase access to education (93%);

· A clear legal framework applicable in the EU, addressing IPR, copyrights, licensing and publishing rights is lacking (76%);

· The variety of resources makes is complicated to find and select right resources for specific needs (76%);

· Development of quality standards and quality assurance tools for OER would have a positive effect (84%);

· It is yet not clear how different actors can adapt their strategies and business models (73%);

· Stronger uptake of OER would generate higher levels of innovation in education and training institutions (90%);

· Wider use of ICT in education would contribute to reduce early school leaving (70%);

· The availability of free digitised school books could lead to a significant reduction in costs of education (72%);

· Availability of high quality European OER would increase attractiveness of European education and training systems (80%);

· ICT didactics are not sufficiently available to teachers, particularly during initial teacher training (87%);

· A stronger cooperation between traditional and open universities could contribute to better use and uptake of OER (86%);

· There is an insufficient availability of hardware and ICT infrastructures in many learning environments, creating imbalances in learner's access to education (75%).

In addition to the questionnaires, the European Commission (EC) received 25 position papers, mainly from publishers and their associations, but also from university consortia and public authorities (at regional level). The position papers recommended support for appropriate ICT infrastructure, including open technical interoperability standards and European cloud infrastructure; support for European businesses in digital learning aiming at global leadership; new methodologies for assessing learning outcomes; development of European quality standards specifically for OER; creation of a multi-stakeholders platform to facilitate partnerships between ICT industry, publishers and the public sector; and alignment of the VAT rates of digital and printed resources and materials.

2.2.        Major implementation gap in education

As indicated in the previous chapter, technological advancements make it possible for individuals to learn anywhere, at any time, following very flexible and individualised pathways and often for free. However, educational institutions are not yet fully exploiting the potential benefits of new technologies as an enabler to innovate and modernise learning and teaching practices[22]. When technology is not used in education, learners are also not developing digital competences to become confident, critical users of new technologies[23].

Education is one of the last sectors which have not yet embedded the potential of ICT. Numerous international surveys describe the seriousness of this implementation gap, its negative implication on learning outcomes and the need for education to take immediate action[24].

It is noted that national policies for ICT education exist in all European countries[25]. These aim to provide the necessary basic ICT skills to learners and ICT training for teachers. In most countries, ICT education is subject-specific; some also foresee cross-curricula strategies[26]. These countries also plead for using ICT as an innovative tool for learning and teaching. Policy and strategy development rests mainly with the central administrative level while implementation involves more local administrations and schools.

Figure 3: Delivery of ICT learning objectives as recommended by central steering documents of MS in primary and general secondary education (ISCED 1, 2 and 3), 2009/10[27]

Example 1 - Spain

In 2012, Spain replaced its former national programme Escuela 2.0 through a new ICT programme named TIC 2012. The general objective of this new programme is to develop an electronic learning platform that improves the management of content and promotes the use of virtual learning environments that facilitate classroom instruction and individualised learning according to the needs of students. For this purpose, the budget allocated for the new programme is 41.5 million euros, a figure considerably lower than the 91 million euros for Escuela 2.0 in 2011. In this scenario co-funding models (public-private) and the participation and educational priorities of the regional communities will have an even more prominent role in continuing the incorporation of ICT and digital educational materials in the education system.

However, large implementation gaps remain. 92% of respondents of the public consultation confirm that the use of ICT and OER in education and training is still too fragmented. Past and recent surveys[28] show that teachers have not yet adopted ICT for learning across all subjects. In science, it is used for looking up information but rarely for conducting experiments or simulations of natural phenomena. In mathematics, it is also rather limited and sometimes used for skills practice. ICT use in language of instruction and foreign languages is more the exception than the rule[29].

It is crucial that educational institutions and all educational stakeholders involved have an integrated vision on how ICT can add-value to learning and teaching. Developing integrated strategies and implementation plans with full engagement of all educational stakeholders is essential for any larger uptake and full implementation of ICT and OER use in education.

Integrated ICT-policies in teaching and learning combined with concrete support measures at school level affect the frequency of students’ ICT based activities for learning in the classroom. Students, as well as teachers, have the highest frequency of ICT use and ICT-based learning activities during lessons, in schools which have general policies on ICT-integration in teaching and learning as well as in subject learning, incentives to reward teachers using ICT, concrete support measures including teacher professional development and the provision of ICT-coordinators. Schools belonging to these two groups, i.e. having policies and/or concrete support measures, are defined as digitally supportive schools[30].

Example 2 - Greece

The Operational Programme 'Education and Lifelong Learning 2007-2013' is a large scale, nationwide funding programme, co-funded by the European Social Fund (ESF) and the Greek State. It is the main funding scheme for upgrading the quality of learning at all levels of the educational system, involving the use of Internet technologies. As part of the programme, the "Digital School Initiative" created an official repository that gives free online access to digital textbooks on all levels of education.

Having formalised school policies on teaching and learning is key towards an e-mature or digitally-supportive school[31]. On average, at EU level and across all grades, around 50% of students are in schools where such policies exist – in writing.[32] However, only 20% of students are in schools where they have actually been adopted. Around 35% of students are in schools where there are plans and measures to support collaboration between teachers and there is time scheduled for them to share, evaluate or develop approaches and instructional material.

Differences between countries are large: at least 50% of students are in digitally supportive schools having policies and support measures in Czech Republic, Denmark, Norway, Slovenia (at several grades, see figure 4), as well as in Bulgaria, Estonia, Ireland and Spain (at grade 4), while less than 10% of students are in such schools in Croatia (at grade 8), France (at grade 4) and Greece (at grade 8 and 11, see figure 5).

Figure 4: Percentages digitally supportive schools in Slovenia

Figure 5: Percentages digitally supportive schools in Greece

2.3.        The underlying problem drivers

Learning sectors are differentiated not only by their needs but also by their development stages. What is at stake obviously varies between different learning sectors. Each problem affects with different intensity each form of education and training (formal, non-formal and informal) and education sector (i.e. compulsory education, higher education, vocational education and training (VET), non-formal and informal youth and adult learning).

This section of the Staff Working Document will discuss the various barriers in Europe to move the use of ICT and OER from its early adopters' stage towards full uptake stage. These problems are being mapped and discussed following the three axes identified in the first chapter: (1) Open learning environments; (2) Open educational resources and (3) ICT infrastructures and tools. The relevance by sectors of education and training is mentioned for each barrier. The best practice examples identified are based on a detailed analysis of the use of ICT and OER in each country[33].

2.3.1.     Open and innovative learning environments

The problems related to the first axe are:

1. Low use of ICT for innovative learning and lack of incentives to develop innovative teaching practices

2. Today's learners may be digital natives but not necessarily digitally competent

3. Insufficient teacher's digital competences

4. Teacher professional development lacks attention to innovative teaching through ICT

5. Evaluation mechanisms rewarding innovative practices for teachers

6. Assessment, recognition, validation and certification of online acquired learning is an open issue

7. Assessment supported by ICT in school education

8. National policy initiatives are fragmented with a large implementation gap

2.3.1.1.  Low use of ICT for innovative learning and lack of incentives to develop innovative teaching practices

While infrastructure barriers to the use of ICT in education have been reduced over the last 5 years[34], the percentage of school and initial VET teachers using ICT in more than 25% of lessons has remained fairly stable[35]. Most teachers have been familiar with ICT for teaching and learning for some years but still use it first and foremost to prepare their teaching[36]. Only a few (15%) use it – and still to a limited extent – to work with students during lessons, and even less frequently to communicate with parents or to adjust the balance of students’ work between school and home in new ways. The overall frequency of use of different types of ICT-based activities in class reported by teachers is around several times a month on average at EU level. But students report lower frequencies. Digital resources such as exercise software, online tests and quizzes, data-logging tools, computer simulations, etc. are still very rarely used by students during lessons.

The following figure demonstrates also the huge diversity between the EU Member States:

Figure 6: % of Grade 8 pupils attending classes where teachers' use of ICT in more than 25% of lessons[37]

Figure 7: Teachers use of ICT in Cyprus

Figure 8: Teacher's use of ICT in Bulgaria

But despite the low use of ICT for learning during lessons, a very large majority of school heads and teachers agree about the relevance of ICT use in different learning activities, as well as concerning the positive impact of ICT use on students’ motivation and achievement, and on transversal skills. They are also close to unanimity about the fact that ICT use is essential to prepare students to live and work in the 21st century. An overwhelming majority of students is also positive about the impact of ICT on the classroom atmosphere and on different learning processes.

2.3.1.2.  Today's learners may be digital natives but not necessarily digitally competent

School education and initial VET

Longitudinal profiling of the evolving digital lives of teenagers and adults demonstrates the pace of change[38]. In Europe, data shows that going online is a part of children’s activities from a very young age (7 to 9); 15-16 year olds spend an average of 118 minutes per day on the Internet, compared to 58 minutes per day for 9-10 year olds; 33% go online using a mobile device; 87% use the Internet at home compared to 63% at school; 75% use social networking sites and 56% display a sophisticated level of use, including playing games with others online, downloading films and music and sharing content peer-to-peer (e.g., via a webcam or message boards).[39]

Contrary to the popular image of ‘digital natives’ navigating effortlessly in web-based settings, many students cannot in reality operate so effectively. PISA results show that even when guidance on navigation is explicit, significant numbers of students still cannot locate crucial information. Today's 'digital natives' are not 'born digitally competent' as has sometimes been claimed[40]. Digital literacy is still an issue. OECD countries still have significant numbers of students who perform poorly in digital reading[41]. These results show also that one must make a clear difference between having access and using ICT effectively.

Also, PISA 2009 data show that the OECD average for 15-year-olds reporting using computers at home is 93%, compared with only 71% using them in school, with a stronger correlation between educational performance and computer use at home than with its use in school[42]. This discrepancy has also repeatedly been reported by European Schoolnet in the first European-wide surveys on ICT use in education (2006) and again in 2013. Students’ ICT use during lessons still lags far behind their use of ICT out of school: Students’ ICT-based activities related to learning at home are more frequent compared to ICT activities at school. Reasons for this are manifold, but one of them can generally be identified as lack of general strategy on integrating ICT for learning purposes at schools

Across the EU Member States, students have more confidence in their digital competences when they have high access to/use of ICT at home and at school compared to students (see figure below). Such higher confidence applies to students’ operational ICT skills, social media skills, their ability to use the internet responsibly, and, to a slightly less extent, their ability to use the internet safely. These students are not just confident in their digital competences, but also positive about the impact of using ICT in teaching and learning. Students, having high access to and use of ICT at home and at school, are defined as digitally confident and supportive students[43].

Figure 9: Average pupil confidence (scale 1-4) in using ICT skills, by type of skills and pupils' use/access to ICT. Grade 8[44]

These findings underline how important it is to effectively develop ICT use during lessons at school for students to become more digitally competent, regardless of the many opportunities some have for using ICT out of school, and even more fundamentally for those still lacking access to it at home. Across the EU countries, on average between 30-35% of students are digitally confident and supportive students, i.e. have high access to ICT at home and at school; the highest percentage of digitally confident and supportive students is systematically found in Denmark at all grades and Norway at grade 11. Across all EU countries, the highest percentage of digitally confident and supportive students is observed at grade 11 in general education, suggesting a particular focus of policies at that education level. Nevertheless, around 50% of students at grade 8 and 11 in vocational education still have high access/use at home, but low access/use at school; it decreases to 35% at grade 11 in general education. Even more alarming is that between 18-28% of students, depending on the grade, have low access to/use of ICT at home as well as at school.

These results show clearly that as the digital divide defined by technology access, at home or in schools, has tended to fade, a second one – based on digital competence – more stubbornly remains: between those who have the necessary competences and skills to benefit from computer use, and those who do not.

The report revealed a positive link between confidence in ICT skills and the use of ICT at home and at school. Students with high access/use both at home and schools are more confident in their ICT skills than those that only report high access/use at home and not at school. The confidence in ICT skills is lowest amongst pupils with low access/use both at home and at school.

A recent analysis by the Eurydice network[45] captures what might be referred to as the culmination of the first the large scale phase of digital development, ‘computers in schools’ and ‘computers at home’, reporting widespread but quite diverse activity throughout the European member states. On the positive side, key competences for lifelong learning are widely referenced in curricula and the integral role of ICT is promoted. A wide range of innovative pedagogical approaches are reported at both primary and secondary school levels, and these frequently integrate the use of ICT. However, there continues to be a strong emphasis on the separate teaching of ICT and on linking outcomes to very specific skills programmes such as the European Computer Driving License (ECDL)[46]. Wider integration of digital media in the curriculum, where it occurs, it often more in support of the teacher than in support of the individual student and the adoption by and large remains within the traditional schooling frameworks and teaching and learning paradigms. The report confirms that, at home, students are more likely to use an Internet-connected computer for entertainment than for learning. The OECD PISA ‘Reading Online’ survey[47] presents a generally positive perspective on the reading abilities of 15-year olds in a digital environment. However, relative to the scope of digital activities of teenagers, reported in a general way in other studies, PISA examines, albeit in detail, a very specific and small subset of such activities.  The New Millennium Learners report[48] arrived at the conclusion that there was little evidence that significant investment in ICT in compulsory education over many years had made any measurable difference at a macro level, (at least in respect of what was actually measured), while acknowledging that innovation was visible at the micro level. In this sense a systemic implementation gap remains.

Higher Education

Many higher education institutions have by now made significant investments in ICT for teaching and learning, for example in Learner Management Systems (LMS, e.g. Moodle or commercially available platforms such as Blackboard, offering extensive synchronous and asynchronous functionality to support course design, teaching, learning, collaboration, assessment and analytics) and by providing 24/7 electronic access to library resources. Campus facilities have been upgraded to offer WIFI access and digital projection/electronic whiteboard facilities are widely available in auditoria and classrooms. There is no doubt that the wide adoption these technologies has been of benefit to traditional cohorts of students, who now have access to a far wider range of resources and the flexibility of working online 24/7 in a ‘blended learning’ mode. Students at distance teaching universities have also benefited from the adoption of the same technologies, and convergence is evident between the fully distance/online mode of delivery and on-campus delivery

However, particularly in respect of LMS, it is difficult to gauge the extent to which their deployment has been fully embedded within faculties or disciplines, or the extent to which their deployment has resulted in a transformation of existing practices. 

The arrival of MOOCs and the growth of open and online education are increasingly shifting the focus to learners as the primary target group. This group consists not only of students enrolled at education institutions but also “self-learners”, everyone from pupils to professionals to retirees who, for their own reasons, want to learn without enrolling in a mainstream programme or needing/wanting a diploma or academic degree at the end. Personal development and employability are important motives for engaging in open education; for example, there are employees who use open education for continual professional development, or for retraining or refresher training.

This shift offers new opportunities for education, especially since the new target groups for higher education (HE), for example, are located around the world, massively extending the reach of open and online education. The demand for open education especially in higher education is enormous, as evidenced by the unprecedented popularity of MOOCs.

Adult learning

Despite developments in ICT infrastructures and new web services, only 53% of the available labour force report that they are confident that they have sufficient digital skills if they were to look for a job or change jobs within the next year. Countries such as Sweden, UK, and the Netherlands report at the higher end with more than 80% expressing confidence in their skills, whereas countries such as Cyprus, Romania, Greece, and Lithuania report at the lower end of the benchmarking exercise with confidence levels not exceeding 40%[49]. These data and declared level of confidence are framed further by findings from IPTS who have conducted research on informal learning communities[50]. Moreover, digital competences among the adult population are unevenly divided, with older people and those with lower qualification levels having lower digital competences than the population in general. It appears that even where digital competence seems to increase over time, a clear socio-economic divide remains in the labour force according to country of location, formal level of qualification and age[51].

There is little data on the extent of ICT equipment available in adult learning institutions or on the extent to which it is being used in learning and teaching of adults. However, it is likely that ICT enabled learning is not at wide spread in this field as it is in the more formal education fields. Even within companies, the use of ICT enabled learning has not reached its full potential as evidenced by a Finnish survey, which shows that only 41% of respondent companies had used ICT enabled learning in their staff training in 2012[52].

2.3.1.3.  Insufficient teacher's and educators digital and didactic competences and confidence

While teachers are quite motivated to use ICT for innovation in their teaching practices, they often lack the necessary digital competences and even more the didactic competences and confidence to use ICT in their teaching.

At EU level[53], 75% of teachers have been using computers and the internet at school for four years or more, but more for preparing lessons than teaching [54]. However, experience of using ICT does not necessarily imply a high level of expertise. Especially in the areas of social media, teachers demonstrate consistently lower levels of expertise than in operating ICT equipment more generally. This is also reflected in the teachers’ frequency and areas of use. One in five grade 8 students in the EU are in schools where teachers never or almost never use a computer. More precisely, one in four students is in a school where the teacher uses ICT in less than one in 20 lessons.

The limitations of teacher expertise of using ICT for pedagogical reasons in the classroom become even clearer when looking at the areas for which teachers use ICT devices. The most frequent ICT based activities of teachers at EU level are related to the preparation of teaching activities (30-45% of students) are taught by teachers declaring they do some form of lesson preparation at least once a week.

In contrast, only 20% - 30% of students have teachers who create digital resources and use the school website or virtual learning environment at least once a week. Similarly, around 30% of students at all grades are taught by teachers claiming they have participated in online communities to exchange professionally with other teachers. And between 60% and 85% of students are taught by teachers declaring they never or almost never communicate online with parents, post homework online for their students, assess students using ICT, or evaluate digital resources[55]. These Europe-wide results suggest that while teachers are familiar with using ICT, the full potential of using ICT as a pedagogical tool in the classroom is not yet realised for a majority of students.

2.3.1.4.  Teacher professional development lacks attention to innovative teaching through ICT

Teacher education and professional development have positive impact on the take-up of new technologies[56]. International surveys indicate that teacher professional development ranging from initial teacher education, in-service training and other types of professional development schemes is the most important condition to ensure efficient and effective uptake of using ICT in education.

In 18 EU countries or regions, curricula for initial teacher education include some provision of digital skills[57]. However, according to a joint EC–OECD study of 2010, 58% of teachers surveyed said they had not received any training on how to use ICT in the classroom. ICT didactics are not sufficiently available to teachers, particularly during initial teacher training. The mostly frequently indicated action teachers would like to receive was "to support teacher education and professional development on ICT didactics and use of OER, and increase access to communities of practice".

Example 3 - Slovenia

The Slovenian government is currently implementing an e-education initiative which consists of a range of projects on textbooks, competences and infrastructures.  One part is designed to improve teachers' e-competences. It has defined an 'e- competence standard' which all teachers and principals should reach. Teachers are trained online and onsite to reach the standard. By November 2012 there were about 32,000 participants in these seminars. The most popular seminars were on Virtual Learning Environments (moodle) and interactive whiteboards.

Statistics presented with the individual country analyses show the different situations in EU Member States[58]. The EU-wide schools survey[59] provides more in-depth insight in what are the issues at stake. On average, only around 25% of students in Europe who are taught by teachers for whom ICT education and training is compulsory. In Lithuania around 70% and in Romania around 65% of students at all grades are taught by teachers for whom it is compulsory to participate in ICT training, while 13% or less of students are taught by such teachers in Luxembourg, Austria and Italy.

Figure 10: Time invested by teachers in professional development activities during the past two years, Slovakia compared to EU average, 2011-12, in % of students

Example 4 - Austria

'Onlinecampus Virtuelle PH' (http://www.virtuelle-ph.at)

'Onlinecampus Virtuelle PH' is a service centre maintained by the Ministry for Education targeted at all Austrian teachers and all Universities of Teacher Education (Pädagogische Hochschulen). It offers online seminars and e-Lectures for teachers' professional development. There are also a number of resources for self-study. Virtuelle PH also provides know how and expertise in the field of technology assist teaching and learning to teacher educators.[60]

To compensate the lack of focus on digital skills in initial teacher education, a large proportion of teachers develop their ICT skills privately. At EU level, around 70% of students at all grades are taught by teachers who have engaged in personal learning about ICT in their own time. Other ways of teachers engaging in ICT professional development include ICT training provided by school staff (50%).

Boosting teacher's confidence using ICT for teaching is a condition for an effective and efficient use. The EU schools' survey shows indeed that students have the highest frequency of ICT use during lessons when they are taught by teachers with high confidence in their own ICT operational, having positive opinions about ICT use for teaching, as well as having high access to ICT infrastructure at school. Such teachers are defined in the survey as digitally confident and supportive teachers.

On average across the EU countries, between 20-25% of students are taught by digitally confident and supportive teachers having high access to ICT. Here again differences between countries are very large. Between 30-50% of students at grade 4 and/or grade 8 are taught by such teachers in Bulgaria, Estonia, Ireland, Portugal, Slovakia, Slovenia and Sweden; conversely, less than 10% of students at the same grades are taught by such teachers in Austria, Belgium, Cyprus, France, Finland, Greece and Luxembourg. In secondary general education, more than 45% of students are taught by such teachers in Denmark, Luxembourg, Norway and Portugal; conversely, less than 10% of students are in this situation in Greece, Romania and Turkey.

One of the most efficient approaches in continuous professional development of teachers is through communities of practices allowing teachers to participate in a professional community that supports the new ideas and practices at the same time as they challenge existing ones[61]. Teachers not only need to rethink what they teach, but also why. However, in order to thrive, communities of practice require time for collaborative learning to emerge. Findings suggest that if teacher collaboration is genuinely bottom-up driven and derived from practice-based experimentation, then communities will gradually grow and be reinforced[62].

2.3.1.5.  Evaluation mechanisms rewarding innovative practices for teachers

As any other professionals in any sector, teachers (including professors and all other educators), are influenced by the way their performance is assessed and their career opportunities influenced. Being careers involving many individuals, public authorities are highly pressured to define very clear and objective performance evaluation schemes. For such, these are generally focused on a relatively small number of criteria, which are easily measurable and clearly comparable. Teachers are generally evaluated by criteria directly related with their input to the students to whom they have been allocated (like the time spent in class), their involvement in the institution administration, and/or their involvement in research (like the number of research papers published). Very seldom are any variables associated with innovation in education or the openness of education considered in performance evaluation schemes.

Many experiences and projects are achieving very positive results all over Europe. However, frequently teachers are developing them beyond their normal working hours or their contractual obligations. Most teachers are not incentivised to introduce new technologies or open practices in education. They are actually de-incentivised by the need to convince leaderships on the appropriateness of their projects.

  To have full involvement of the high number of teachers with a potential commitment to improve education through open practices it would be essential to have these practices considered in the framework of teachers' performance evaluation schemes.

2.3.1.6.  Certification, validation and recognition of online acquired learning is an open issue

The recent EC recommendation on the validation of non-formal and informal learning[63] already referred to the importance of recognition of skills and competences acquired through online learning and open educational resources when discussing the value of online learning.

When students learn within the context of their formal education, it is an obvious step for the educational institution to recognise the knowledge acquired, for example by noting it in their portfolio[64]. This is evident in higher education which has an accreditation system for guaranteeing quality and standards. It also applies to learners when the labour market demands formal evidence of competence, knowledge, or skills.

Up to now it has been virtually impossible to acquire formal recognition for learning achieved by OER. This has to do with the authenticity and validity of students' performance outside a controlled environment and fraud prevention. There is therefore an enormous need to develop a method for evaluating and certifying open learning in an effective, efficient, and confidence-inspiring manner.

Example 5 - France, Germany

VAE system – France (http://www.francevae.fr/francevae/) The VAE system (Validation des Acquis de l'Experience) is used to deliver whole or partial qualifications. Each Ministry awarding qualifications has developed its own rules for the context-specific implementation of the principles outlined in the legislation. Generally evaluations are made on the basis of a portfolio where the applicant describes his/her experience. Further written evidence of the experience is also frequently requested. This declaration must include details of skills and competences used in their activities. Further evaluation methods include observations of real or simulated working activities, interviews and presentations. Certificates awarded by the private sector can be recognised after an accreditation process. A similar system is in place in Luxembourg[65]. ProfilPASS – Germany (http://www.profilpass-online.de/) In Germany, different validation methods are in place. The ProfilPASS is a system of formative validation for both adults and young people, while the external students' examination leads to the award of a full qualification in a recognised apprenticeship trade. Access to a higher education course can be granted through the 'access for qualified workers' route. Knowledge and skills can be recognised up to a maximum of 50% if their content and level are equal to the equivalent formal qualifications[66].

An increasing number of universities providing online programmes (or parts of programmes) also offer methods of guaranteed and alternative certification (for example by means of “badges”). Examinations for MOOCs can be taken at Pearson test centres in a controlled environment[67]. For a few of its open courses, Saylor.org offers assessment for credits[68]. However, these are payable services. Accreditation organisations such as the Council for Higher Education Accreditation[69] and the American Council on Education[70] have now expressed the intention of accrediting MOOCs, thus making their quality apparent. If this development continues, they can become important alternative learning pathways – virtually free of charge – not only for lifelong learning but also for basic degrees and qualifications. Even though the business models behind them are still to be developed, their proliferation will force higher education institutions to think hard about their actual business models.

Another emerging trend for recognition is to award “badges”. A badge is a (digital) insignia awarded to a person who has achieved a particular level of performance[71]. Various different names are applied. The OpenStudy platform, for example, uses “medals” and “SmartScores”, leading to “certificates”. Codecademy works with “points” and “streaks” as well as badges. At Coursera, participants who have completed all the components of a course can acquire a “certificate of participation”. It is, however, difficult to organise formal recognition for this system. The primary function of the badges is to act as a signal for participants in determining who plays an important role or knows a lot. To increase the value of badges, it is important to get some level of European-wide agreement on which kind of badges and the criteria are recognised for validating learners' performance.

OpenStudy Certificates involve cooperation between OpenStudy and the worldwide OpenCourseWare Consortium (OpenStudy, n.d.). Participants taking an OpenCourseWare course supported by OpenStudy can sign up for a (worldwide) study group, which has a forum where they can ask and answer questions. Activities within the course are tracked, as is progress in the course and in the community. By answering questions put by fellow participants, the learner can demonstrate his/her understanding of the material, thus gaining medals. A participant can gain a certificate if he/she has been active within the system for at least four weeks, with questions posted and answered for at least 70% of the course topics. If the participant complies with the requirements and his/her SmartScore has increased by 20 points, he/she receives a certificate of participation for a “self-directed learner”: “You have demonstrated engagement, teamwork, problem solving as you participated in this open online course and created an online portfolio of your activity.” With Mozilla Open Badge Infrastructure (Mozilla Open Badges, n.d.) learners can increase their competencies via a number of different channels, earning badges that are allocated to them by individuals or organisations. The learner can collect, manage, group, and share his/her badges on the website. He/ she can then decide which badges to make visible (via a personal website, a blog, a social network profile, or a jobs website). Usage of this system can also be good for the reputation and profile of those who allocate the badges.

In recognition process partnerships between institutions are important. The institution that recognises learning must have confidence in the quality of the education offered, and must be able to assess it for itself. The recognition of credits in Erasmus student exchanges provides a good example[72]: recognition is institutionalised on the basis of the relationship of trust between the participating institutions and can therefore be successfully incorporated into accreditation procedures. In the case of education acquired by the OER, that relationship of trust does not yet exist and should be forged.

The possibilities for formalising recognition are increasing now that the providers of MOOCs are actively making secure supervised examinations possible. Udacity and EdX have signed a contract with Pearson VUE, an independent commercial provider of examination services. Pearson has testing centres worldwide where the identity of learners can be verified and exams can be taken under controlled conditions[73]. The question is whether, given these trends, the business model of traditional higher education institutions is still tenable (see further). Also, the spirit of free OER based education is undermined when the examinations that accredit learning become payable.

2.3.1.7.  Assessment supported by ICT in school education

One of the key challenges for education systems in many European Member States is the assessment of key competences[74]. ICT offers many opportunities for the provision of assessment formats which comprehensively capture all key competences even the more transversal and complex ones such as critical thinking or creativity. These transversal competences are often acquired across subjects and even outside school, informally and non-formally. It is therefore important to investigate how ICT supported assessment and recognition of competences is considered in school education.

There is a general awareness among school educators that ICT can help students to self-assess as part of their learning-to-learn.  In a number of European countries, ICT tools are already being used to support self-assessment. Liechtenstein already uses them in secondary education; Bulgaria, Lithuania and Iceland have pilot projects, while France, Malta and Slovenia are planning to use self-assessment[75].

Overall, the potential of ICT in the comprehensive assessment of competences in school education, including less tangible and generic skills, remains largely untapped and take-up in school education is still low.[76] To seize the opportunities offered by ICT, targeted measures are needed to encourage the development. ICT-based assessment provides a gateway for more formative assessment, measuring actual learning, appreciated by teachers and students, and a potential shift away from summative high-stakes assessments at the end of the school year or term, criticised for measuring the ability to recall information at a given time.

Currently, two conceptually different approaches to assessing competences can be distinguished.  On the one hand, there is Computer-Based Testing using multiple choice, quizzes, simple games and audio-visual representations for testing knowledge, skills and attitudes, as well as ePortfolios. Many Member States are using CBT for more effective and efficient testing. Computer-Based Assessment (CBA) approaches on the other hand, offer a promising avenue for embedded assessment of the more complex and behavioural dimensions of competences, based on different technologies analysing student performance like Learning Analytics. Many of the currently available technology-enhanced learning environments, tools and systems recreate authentic learning situations which require complex thinking, problem-solving and collaboration strategies and thus allow for the development of both transversal skills in addition of core subject knowledge. Some of these environments allow learners and teachers to assess performance, understand mistakes and learn from them. Even though many of these programmes and environments are still experimental in scope and have not been mainstreamed in education and training, commercial products start to emerge (eg. Knewton[77])[78].

ePortfolios are ideally suited to the assessment of collections of work produced by students and are thus particularly powerful tools for communication in the mother tongue, communication in foreign languages and cultural awareness and expression. ePortfolios are already widely used in European schools as a means of supporting the formative and summative assessment of students’ creative productions. E-Portfolios have been implemented in school education in Belgium, Austria, Portugal, Romania, UK and Turkey; while Bulgaria, Germany, France and Iceland are in the pilot phase and eight countries in the planning. In Portugal and the United Kingdom e-Portfolios are available to students throughout their entire educational career and are assessed by awarding bodies in England, Wales and Northern Ireland. In contrast, Poland and Liechtenstein are focusing more on providing teachers with ICT tools to monitor pupil progress[79]. However, more innovative formats of cultural and artistic expression, such as blogs, wikis, tweets, audio and video recordings, etc., are seldom included. Educators often do not realise that ePortfolios can be powerful tools for encouraging online collaboration, self- and peer assessment, which contribute to and at the same time assess students' learning to learn skills.

2.3.2.     Open Educational Resources challenging education

While the rapid increase of OER's and in particular the recent proliferation of MOOCs indicate that the educational world is keen on embracing this phenomenon made possible by the internet and social media, OER are still challenged by many unsolved questions. These problems are:

1. Low use of OER for innovative learning

2. OER supply is currently fragmented

3. OER supply is not quality assessed

4. OER opens up education towards informal learning but educational practices are not in line with the increasing OER supply

5. Lack of appropriate business models for OER

6. OER and publishers: opportunity or threat?

2.3.2.1.  Low use of OER for innovative learning

School education and initial VET

Centrally promoted digital resources (openly available or not) are widely available in the EU[80] to support teachers in their use of ICT for innovative teaching and learning in the classroom. The majority of European countries have online platforms, blogs, forums or other social networking sites that facilitate the sharing of experience and exchange of materials between teachers.

Example 6- Denmark

EMU portal – Denmark (www.emu.dk) The main portal for educational content is the EMU. It provides access to a federation of OER repositories which were previously operating separately but since 2012 have been consolidated under the roof of EMU. The concept is liberal in the sense that professionals can publish content or references to content without having to meet any set of pedagogical or technical specifications. Content may be free, partly free or fully commercial, and varies from descriptions and links to books for educational use or other paid services, through free samples, to fully free content. The EMU is closely connected to the school and high school educational levels; uploading content demands a login for the intranet services offered to these educational levels. EMU also contains the main national repository for school teachers and students 'Materialeplatformen', which provides access and summaries to all online learning resources. It was initiated by the Ministry of Education but is implemented together with publishers who can also publish content on the platform. A screening procedure exists for all materials produced by teachers and uploaded to the platform. This is provided by an organisation administrating ICT-related services to the Ministry of Education. It is used primarily in primary and lower secondary and in general upper secondary education.

However, availability does not mean that these resources are actually used by teachers and learners. With the exception of the EU School survey[81], not many large scale studies explore if and how teachers use OERs. However, there is a general agreement among scholars surveying the OER landscape that usage falls far behind its potential across the sectors.[82] Especially primary and secondary schools have yet to realise the potential.

Between 50% and 80% students (depending on the grade and the specific tool concerned) never or hardly ever use digital resources, openly available or not, such as digital textbooks, exercise software, broadcast/podcast, data logging tools, simulations or learning games/video games[83]. Overall, digital resources and tools are more frequently used at grade 8 than at grade 11 in general education. This low frequency of digital resources is quite alarming, especially as these resources seem to be widely available for use[84].

Figure 11: Use of resources and tools during lessons at grade 11 general education (in % of students, EU level, 2011-12)

Moreover, when OER are used by teachers, a majority are passive consumers simply browsing for resources rather than participating in the creation and sharing of them. Data from the Wikiwijs project show that only 3% of users actively contribute to the pool of resources[85]. These statistics suggest that very few teachers in fact engage in open educational practices, a term used to describe the focus on learning as a process of construction and sharing which is essential for the successful use.[86] The potential of OER as a tool of innovation and collaboration is thereby not achieved.

Higher Education

In higher education, compared to school education and initial VET, OERs are neither used to their full potential even the supply of OER is more available.

59 Higher Education Institutions from nine Member States are member of Open Courseware Consortium, representing 24% of the total members[87]. 860 EU organisations run about 1,031 open access repositories[88]. The number of courses, modules or collection available for free counts several thousand: 14,000 courses through the OpenCourseWare Consortium; 20,000 modules through Connexions; 38,000 through OER Commons, etc. Universities like Stanford, Princeton, EPF Lausanne or Edinburgh, amongst many others, have established partnerships with Coursera, while Harvard and the MIT launched in 2011 their joint venture EdX to offer university-level courses from a wide range of disciplines online to a worldwide audience. Coursera currently have 9, 5 million enrolments.

In order to realise the full potential of OER, barriers for using and sharing OER need to be removed. The primary barrier identified in a large scale study of higher and adult education was the “lack of interest in creating or using OER” amongst teachers, suggesting a lack of incentives to adopt open educational practices[89]. For example, the creation and sharing of OER are not generally taken into account by promotion systems, leaving individuals dedicating time to OER comparatively less well off to their peers who use the time for more recognised pursuits.

2.3.2.2.  OER supply is currently fragmented

It is not obvious to accurately estimate the number of OERs available in Europe due to the lack of reliable monitoring studies[90]. However, rough estimates of numbers of OERs to be made available in the EU funded Open Discovery Space project which incorporates a large number of European repositories and focuses on school education lie at 1.5 million[91]. This shows that there is no real lack of supply of OERs but these are very diverse, difficult to find, through multiple access points, and no comparable approaches.

As shown by the country analyses, some EU Member States have national strategies to foster the use of OER in education and training. Countries have established platforms and repositories where teachers, trainers and learners can find and share digital educational resources. Some of them target specific groups (e.g. teachers).

Example 7 - Cyprus, Finland

Schoolnet DIA.S portal – Cyprus (https://www.dias.ac.cy/en/Pages/intro.aspx) The Schoolnet DIA.S portal offers access to online courses and content for primary, secondary and vocational education. It also provides teachers with a tool to organise and create digital interactive activities like experiments, measurements, simulations etc. and the possibility to make them available online. Le Mill – Finland (http://lemill.net/) Le Mill is an online community for finding, authoring and sharing OERs. Le Mill has nearly 15,000 teachers contributing from 63 countries and almost 24,000 learning resources in 83 languages. It was designed by the University of Art and Design of Helsinki as part of the Learning Resource Exchange service developed by European Schoolnet.

A recent analysis of OER initiatives in EU Member States by the European Commission (May 2013) identified 24 OER initiatives mainly covering simultaneously school education and VET whilst five of them (in BEfr, FI, HU, IT and NL) have a wider scope also encompassing higher education and adult learning[92].  The majority of the initiatives are publicly funded and primarily target school teachers. In five cases, they explicitly target both teachers and students (in EE[93], FI[94] and SE) or students only (in ES and IT). Only four initiatives (in BEfr, IE, LU and PT) have a wider remit, targeting the whole education community (i.e. teachers, school management and administrative staff, students, parents, inspectors, etc.).

Overall, these initiatives mostly offer education-related information, pedagogical tools/materials (e.g. lesson plans, textbooks (or links to), quizzes, videos, pictures, etc.) to support teachers’ work. The language is mostly limited to the country language(s); only the OER initiatives addressing higher education offer English courses. Some of the initiatives may also offer additional functionalities aimed to foster collaborative work (through webinars, forums and exchange of good practice, etc.) among teachers and/or other users (as found in CY, NL and PT) or to allow them to re-mix and re-use content to create their own lessons (as reported in CY, EE and FI[95]). In several cases (BEnl, CY, EE, FI, NL, PL and PT), pedagogical resources are mostly (or even exclusively) generated by teachers.

The analysis on the actual use and uptake of OER among these 24 European OER initiatives shows that this information is overall scarce and, where available, often patchy. Most relevant findings – not comparable though - are found in three countries (BEnl, CY and NL).

Example 8  - Belgium and the Netherlands

Wikiwijs – the Netherlands (http://www.wikiwijs.nl/task) Wikiwijs is a programme intended to promote the use of open educational resources (OER) in the Dutch education sector. It includes an Internet portal where instructors can search for OER adapt them combine them with other educational resources and share them with other instructors. The resources intended for higher education come from the collections of higher education institutions in both the Netherlands and other countries. Since it's launching in 2008 the Wikiwijs initiative has steadily gained in visibility and attractiveness with a number of uploads and downloads respectively tripled and multiplied by five between 2010 and 2012. A survey focusing on the use of the tool is carried out annually. Notwithstanding these promising figures the latest findings (2012 survey) show that there are still areas for improvement as slightly over 50% of surveyed teachers do not know about the initiative. KlasCement – Belgium (http://www.klascement.be/) In the case of the Belgian (BEnl) KlasCement initiative which was launched in 1998 by a teacher and a group of volunteers its value has been progressively acknowledged at both community level (the initiative has been under the remit of the Flemish Minister for Education and Training since January 2013) and outside the country. KlasCement has been indeed replicated in the Netherlands into two versions namely ‘klascement.nl’ (addressed to Dutch teachers) and ‘klascement.eu’ (for teachers all around the EU).

In spite of these positive examples, the limited use of OER by teachers is linked to the fragmented distribution of resources and their visibility. These portals represent an environment of multiple access points, making it difficult for a teacher with little time to operate[96].  It is of utmost importance that teachers and educators have access to OER through environments which are already close to their teaching environments and preferred teacher platforms and portals, but also provide access to all possible OER available across Europe and even across the globe. Finding OER in the language of their teaching is very important.  A federated platform of OER using teachers' preferred platforms and portals to give access to all OER available by linking up to all existing local, regional and European existing platforms, could be seen as the way forward[97].

Interoperability between these repositories is a challenge for technical, semantic and organisational reasons. A number of EU funded projects (e.g. through  LLP, eContentPlus, FP5 and FP7) has focused on these issues. Most repositories adopt one of the main three approaches to collect and organise; namely being a content repository; being a link or metadata repository; or a hybrid repository that hosts content and links to external OERs.[98] This creates a variety of issues for the teachers who require multiple user accounts to share their resources, be aware of varying standards for resources and their metadata and have to adapt their resources accordingly. Furthermore, as repositories have to acquire a critical mass of OER in order to attract users, the distributed nature of accessing OER suffers from serious inefficiencies.

The availability of quality digital resources is not sufficient, especially when addressing a specific combination on language/education sector/subject. 92% of respondents of the public consultation confirm that the use of ICT and OER in education and training is still too fragmented. The fragmented nature of OER in Europe is due to linguistic and cultural boundaries and is a serious obstacle for the "learning industries" to be further involved in emerging markets. When digital educational resources are dominated by the English language, Europe is unable to exploit opportunities coming from its multilingualism.

Open Educational Resources' availability in different languages is highly concentrated, mainly in English. For example when considering those provided through the Learning Resource Exchange[99], a service of European Schoolnet that focuses on the reuse of OER at the European level, we observe that of the approximately 235,000 resources available, more than 57% are in English. The second more frequently available language in that platform is Dutch with 12% of resources, followed by Italian with 9% and Catalan 5%. What is most preoccupying is that out of the 32 languages identified in that portal 9 comprise less than 1% of available resources. This clearly illustrates the lack of availability of reusable resources at the European level in many languages.

Figure 12: Availability of content in different languages, in %

2.3.2.3.  OER supply is currently not quality assessed

Whilst online materials for educational purposes are rising in prominence, it is crucial that the material they use is of quality and is both effectively and regularly quality checked.  Quality of OER is another obstacle to extend their use: "lack of time to find suitable OER materials" (56.8%), "lack of OER that are culturally relevant to the user" (50%) or "lack of quality of the OER" (47.8%)[100].

76% of respondents In the public consultation in the context of the 'Opening up Education' initiative, mentioned that finding the right resources for their specific needs is a serious barrier for a wider use of OER. This issue linked with easy access to quality contents in all sectors of education but affects more acutely the quality of learning that takes place in non-formal and informal settings.

The panoply of sources for learning materials oblige to have quality assurance models, as well as technical search solutions so that individuals are supported in the task of assessing the quality and appropriateness of the materials available[101]. Time can be a strong incentive or disincentive to use ICT and online resources for learning and teaching[102].

Nowadays, the proliferation of websites, platforms, blogs makes it difficult for any user to easily find and recognise quality and appropriate contents. This implies an increasing cost for the user in terms of time. Not being able to find it, the user (educator or learner) lacks information. The complete and free information assumption of free markets is not verified, thus generating inefficiency. This is a strong obstacle for a further usage of OER, and Internet-based resources in general.

Mapping of OER quality approaches in the Member States

Quality assurance models used by providers of OERs range from automated checking of the completeness of metadata, using ISO or EFQM standards to certify quality, to working groups of selected teachers assessing and adapting resources[103]. According to recent literature[104] on OER, ‘new ways of assuring and assessing quality are increasingly being developed, in co-existence with traditional quality assurance methods and mechanisms. Peer review of OER learning materials based on the country analyses can be combined with user comments and ratings on the web. The quality of OER is primarily ensured via peer review in the case of eleven initiatives delivered in ten MS (BEfr, CY, CZ, EE, IE, IT, NL, PL, PT and UK). Peers are in most cases peer teachers or sometimes subject experts.

In the UK, participating teachers are financially rewarded for their review. In Ireland and in the Netherlands the process jointly associates teachers and experts whilst in Portugal[105], all content submitted by school teachers is reviewed by academic peers who evaluate the quality following the same approach than for the publication of articles in scientific journals. 

Apart from peer review, the methods used for ensuring the quality of OER resources may involve individuals who are specifically assigned to act as editors (as in CZ, EE, FI, LT, LU, NL and SE) or moderators (as in EE). In Sweden, 8 editors work for instance 3 hours per week to keep the Länkskafferiet portal up-to-date. Their role notably consists of reviewing and assessing the proposals for new websites to be added to the portal and consider issues such as the structure of the site, its ease of navigation, appropriate use of language whether in Swedish or English and appropriate vocabulary. Reference to more traditional quality assurance methods such as inspection was found in the case of the two French initiatives[106]. Proposed content is firstly identified by each ‘académie’[107] which circulate the information to inspectors who are in turn responsible for assessing this content.

Among other ways to ensure the quality of online content, use of quality standards and design and promotion of quality labels are being used in some countries. Quality standards (EE[108], FI[109] or LT) may build on existing standards such as in Lithuania where specially trained staff indexes online content in conformity with the LOM AP standard[110] or in Finland where all content must be in line with the national e-educational resources guidelines ‘E-learning materials for teaching and learning’. This may alternatively involve ad hoc guidelines as in the case of the Estonian initiative where ‘guidelines for creating a quality e-course’ have been specifically designed for the purpose of the initiative. The latter have used the “Quality Manual for E-learning in Higher Education” of the European Association of Distance Teaching Universities as a basis. Designing and promoting quality labels were found in the description of the Estonian initiative that has launched an ‘e-course of the year’ contest since 2004.

For higher education 27 in-depth countries have been analysed by the LLP project 'Policies for OER Uptake' (POERUP)[111]. A full analysis, comparison and policy recommendations will only be available by mid-2014.

To summarise: quality of OERs is perceived as another key problem for educational professionals and policy makers. While many OER repositories adopt some form of quality assurance model, these remain incomplete. While the latter examples are fairly thorough forms of quality assurance and can be useful for building trust in the standards of a collection of resources, centralised approaches are often seen as less appropriate to more user focussed approaches as the quality of a resource is highly subjective and depends on the context used. Furthermore, centralized approaches are very costly, time consuming and difficult to organise. As most OER providers are not commercial and cost and sustainability are key issues, more common and realistic models rely on communities of teachers who adapt, tag, review, and rate resources[112].

2.3.2.4.  Lack of appropriate implementation models for OER

These new ways of looking to learning through OER (and MOOCs) implies that educational institutions rethink their actual implementation and business models independently if they are school, VET, HE and/or adult learning institutions[113]. Currently only higher education is reflecting on how OERs will affect the educational landscape and data is rather scare. The following will therefore focus on higher education but it is expected that the other educational sectors will follow soon.

By providing free online education to large groups of learners, MOOCs (and OER in general) are challenging the traditional business models of universities. Organisations offering MOOCs such as Coursera have seen their user base increase rapidly. Less than a year since its launch, Coursera already has close to 2 million users and the number of universities offering free online courses is also rising with unprecedented speed. OER like MOOCs have the potential to substantially increase access to high quality education and create competitive pressures for all universities to improve their teaching and course provision.

Schuwer and Janssen distinguish three perspectives or approaches that a higher education institution can select regarding OER, with three different associated types of sustainability:

1. an OER project so as to gain experience, with a funding model

2. a relatively independent OER activity, intended to generate its own income (revenue model)

3. OER as part of the institution’s strategy to provide education for the future

Implementation model 1: The number of institutions that say they will be exploring the value and function of OER is increasing (approach 1); this is an international trend. See, for example, the large number of newcomers at the 2012 OpenEd Conference in Vancouver and the growing number of members of the Open Courseware Consortium[114].

Implementation model 2: The second approach is to apply a “freemium” business model, in which money is earned by customers paying for OER in printed form. Due to the rise of Coursera and Udacity this business model has been slightly adapted[115]. Educational resources are no longer available “for free”; but are now exploited commercially. The resources continue to be “open” to the extent that users can alter and add to them. The intention is to continue to use the “wisdom of crowds”, but income is necessary in order to guarantee quality and more complete OER-based courses are also becoming available[116], generally in the form of projects with external or internal funding. It still appears to be very difficult to apply a sustainable OER-based business model after the pilot phase

The xMOOCs provided by Coursera, Udacity, and others indicate the advent of a new business model. The dominant model in commercial distance education is one of education – including testing and certification – on a large scale and at a low price. Revenues are achieved by having a large number of participants. By contrast, the new competitors’ model involves providing a complete educational experience, free of charge, created by leading universities such as Stanford, MIT, and Harvard. Parties such as Coursera and Udacity expect to generate their revenues from activities such as testing and certification. A second source of revenues is for third parties to be permitted – on a payment and profit-sharing basis – to make use of copyright-protected materials, with anyone who wishes to take the course having free access. A third source involves the analysis and sale of data that can generate mass participation. A potential fourth flow of revenue is from job placement services, i.e. providing companies with the details of appropriate job candidates from among course participants (in return for payment). See, for example, the details of the contract between the University of Michigan and Coursera[117].

It will need to become clear in the next few years whether this business model is effective, and whether mass participation continues. If that is in fact the case, xMOOCs can become major competitors for open and distance education.

Implementation model 3: The best prospects for higher education institutions when OER could be embedded within their strategy and core activities (approach 3). OER can make a major contribution to the performance and quality of higher education, thus helping tackle a number of challenges.

However, today many higher education institutions have neither an overall strategy nor a policy as regards OER.  Making the business model chosen by the educational institutions is a must. The public consultation as input to this Staff Working Document showed that 73% of respondents believed that a lack of new business models is preventing a full exploitation of ICT and OER in education and training.

Providing a range of different business models based on best practice examples would be an asset and would help any HE or even other type of educational institutions to discuss the various options and make an appropriate chose which business model fits best the vision of the institutions and which roadmap could be taken.

2.3.2.5.  OER and publishers: opportunity or threat?

For publishers the main challenge is to find appropriate business models while users who generate content perceive the unclear copyright and licensing frameworks as a major obstacle. Educational publishers are seeing how new actors, like digital giants as Apple and Microsoft, provide educational materials, as well as teachers produce and share their own contents for free through new "bottom-up" practices. The public consultation showed that 73% of respondents believed that a lack of new business models is preventing a full exploitation of ICT and OER in education and training. There are also social and political pressures to increase the use of free online resources in order to reduce costs in education and training.

Despite their significant investments in ICT, publishers have concerns about which new business models could be developed. They perceive this implies commercial risks, possible difficulties to make returns of investments and a major risk of losing intellectual property[118]. Some cases of successful business models exist, like the Irish social enterprise ALISON that provides free online learning resources for basic and essential workplace skills, and offer complementary paid-for certificates as a complementary service[119].

Example 9 - Ireland

'Advance Learning Interactive Systems Online' (ALISON – www.alison.com) is a social enterprise which provides free online learning resources for basic and essential workplace skills. Certificates or diplomas are sold to learners after the completion of most courses. ALISON offers more than 400 courses to a community of over 1 million learners.

Online resources and textbooks are currently seen as complementary instruments[120] by European publishers. Complementarity increases quality of teaching and, at the same time, creates incentives to improve quality of commercialised contents due to an increased competition, which may even reduce costs.

The production of textbooks is characterised by high fixed costs, different entities choosing the textbook and buying it, low price-elasticity and thus relatively little competition[121]. In many countries, the school textbooks submarket is strongly financed and/or regulated by the State. Several public authorities delegate "de facto" textbooks production to publishers[122]. Both are “expected” to guarantee quality and appropriateness of contents. The current economic and financial crisis obliges nonetheless to review the efficiency of the system and in some countries, textbooks provision is becoming an issue, both for families and for public budgets. Even if at aggregated level the cost of textbooks represents a small percentage of total public and private education expenditure (around 1%), provision of textbooks by families is becoming a real issue in countries like Ireland, Spain, Italy or Portugal[123]. In this context it should also be recalled that currently the VAT rate applied to digital (educational) textbooks is higher than the VAT rate applied to physical (educational) textbooks. The Commission is working on the reform of the VAT system and is investigating the possibility to make digital books, including digital educational resources, more accessible.

Example 10 - Slovenia

 An e-textbooks pilot which is part of the e education initiative encourages and provides support and infrastructure to teachers to produce their own digital textbooks. All textbooks are produced with a Creative Commons license. In 2012, four e-textbooks were produced and 25 are planned for 2013. The process is designed to improve teachers and students' digital competences as well as address the lack of digital textbooks available.

Box 2: Specificities of the school books submarket

National policies concerning school textbooks are variable but with common characteristics. Production of textbooks is generally commercial but public authorities use to play a relevant role to determine or authorise contents. This is a major particularity of the school books sub-sector: it is strongly financed and/or regulated by the State. For example, public authorities of Austria, France, Germany, Hungary or Poland approve the textbooks that can be used at schools, in some cases after prescribing the content, format, cost or the frequency of updates. At the other extreme, there is not public intervention concerning the contents in Ireland, Sweden, of the UK, while Italy, the Netherlands or Spain are in an intermediary positions (respectively, the State provides guidance on costs and frequency of updates, the Ministry prescribes educational attainment targets, and Autonomous Communities recommend a list of books). Public authorities determine contents and select textbooks in an open competition, co-funded by the European Commission at 75% and the Greek State at 25%. In most countries, teachers and/or schools decide the educational materials that have to be used by pupils – but within the list or constraints determined by the Ministry of Education. Member States like Austria, Belgium, Denmark, Finland, France, Germany, Greece, Luxembourg, The Netherlands, Slovenia, Sweden or the UK, textbooks are provided for free, at least in primary education and often in the whole compulsory education. Parents have to pay for them in Hungary, Italy, Ireland, Poland, Portugal or Spain. Due to the current economic crisis, this is creating problems to an increasing number of families who cannot afford for such expenditure.

In addition, according to public consultation, there is not enough collaboration between the traditional publishing industry and ICT companies, implying a waste of complementary know-how with consequences on the quality of the educational resources produced. Integrating ICT in mainstream education and training requires the involvement of publishers and the private. Incentives could be created to address the current barriers and stimulate the emergence of new business models among the publishing industry.

2.3.3.               ICT infrastructures and equipment stay a recurrent issue to tackle

Up-to-date and adequate ICT infrastructure is one of the crucial pre-requisites for integrating digital technologies in education and training systems and for the benefit of citizens at large. Digital technologies evolve very fast and require constant efforts to be updated, but the same is true for all infrastructures. Even though the provision of new digital facilities can demand huge investments from private persons, education and training institutions, and public authorities, many educational authorities are making critical calculations and comparisons on the cost-effectiveness between physical infrastructure and material and digital ones[124]. 

The following problems have been identified:

1. Uneven availability of ICT infrastructures and tools, including connectivity, across Member States

2. Absence of open interoperability standards

2.3.3.1.  Uneven availability of ICT infrastructures and tools, including connectivity across Member States

Uneven availability of crucial digital infrastructure (broadband, devices) leads to inequality and increases the gap between teaching practices and ICT in society.

This issue is particularly relevant in schools and VET. The figure below shows that the availability of the infrastructure in the EU in these sectors has generally improved in recent years, but there are still large disparities between Member States.

Figure 13: ICT infrastructure trends (EU average)[125]

Infrastructure || Grade 4 2011 || Grade 4 2006 || Grade 8 2011 || Grade 8 2006 || Grade 11 Gen 2011 || Grade 11 Gen 2006 || Grade 11 VET 2011 || Grade 11 VET 2006

Computers per 100 students || 16 || 10 || 20 || 11 || 24 || 13 || 33 || 16

Computers connected to the internet per 100 students || 15 || 8 || 19 || 10 || 23 || 12 || 31 || 14

% computers in labs || 53% || 74% || 67% || 96% || 67% || 97% || 66% || 93%

% schools with broadband || 92% || 65% || 95% || 71% || 96% || 75% || 94% || 75%

% schools with broadband via ADSL || 53% || 42% || 52% || 51% || 52% || 51% || 51% || 54%

Schools having support or maintenance contract with a service provider || 37% || 48% || 43% || 46% || 45% || 47% || 42% || 46%

% school with a website || 72% || 55% || 88% || 76% || 90% || 88% || 92% || 85%

Email for > 50% of teachers || 60% || 67% || 57% || 64% || 66% || 62% || 66% || 64%

Email for > 50% of students || 23% || 21% || 29% || 28% || 33% || 28% || 31% || 29%

% schools with a local area network || 64% || 50% || 69% || 68% || 82% || 75% || 86% || 72%

According to OECD's PISA study, the median pupil/computer ratio at EU level in 2009 was 2.15. This was also the case in most EU countries, but in countries like Greece, Italy, Poland and Slovenia and to a lesser extent Belgium (French Community), Bulgaria and Sweden, computer availability is not so large. Even within countries, disparities are sometimes very significant[126].

Figure 14: Distribution of student/computer ratio in schools attended by pupils aged 15, 2009[127]

|| Countries not participating in the survey ||

Percentile 25 || Percentile 50 || Percentile 75

(P) = Percentile.

(P) EU || || BE fr || BE de || BE nl || BG || CZ || DK || DE || EE || IE || EL || ES || FR || IT || CY || LV || LT || LU

25 || 1.37 || || 2.08 || 1.29 || 0.88 || 1.84 || 1.28 || 0.89 || 1.47 || 1.41 || 1.33 || 3.79 || 1.44 || || 1.75 || || 1.21 || 1.68 || 1.00

50 || 2.15 || || 2.62 || 1.63 || 1.50 || 2.73 || 1.81 || 1.32 || 2.15 || 2.19 || 2.08 || 6.00 || 1.95 ||   || 2.92 ||   || 1.75 || 2.33 || 2.18

75 || 3.67 || || 4.23 || 2.62 || 2.28 || 4.27 || 2.73 || 2.38 || 3.46 || 2.92 || 2.96 || 8.19 || 2.70 ||   || 4.93 ||   || 2.58 || 3.38 || 2.88

|| || || || || || || || || || || || || || || || || || ||

(P) HU || MT || NL || AT || PL || PT || RO || SI || SK || FI || SE || UK- ENG || UK- WLS || UK- NIR || UK- SCT || IS || LI || NO || TR

25 || 1.50 || || 1.30 || 0.79 || 2.75 || 1.43 || 1.80 || 2.19 || 1.83 || 1.88 || 1.89 || 0.93 || 1.11 || 1.04 || 0.56 || 1.00 || 0.95 || 1.00 || 3.13

50 || 2.10 || || 1.93 || 1.09 || 4.39 || 2.00 || 2.86 || 3.73 || 2.62 || 2.67 || 3.00 || 1.28 || 1.43 || 1.26 || 0.80 || 1.77 || 1.90 || 1.52 || 5.56

75 || 3.10 || || 3.00 || 2.08 || 6.42 || 2.88 || 3.93 || 5.60 || 3.70 || 3.60 || 4.55 || 1.71 || 1.99 || 1.85 || 1.07 || 2.30 || 2.88 || 2.28 || 11.04

In 2011, between 44% (grade 11) and 76% (grade 8) of students in the EU were at a school which had slow or no broadband, made limited use of Internet facilities or had no ubiquitous access to ICT equipment. Only 61% of secondary students and 27% of primary pupils were at school equipped with a virtual learning environment (VLE), with national figures going respectively from 12% to 98% and from 6% to 96%[128]. Such uneven access was also perceived by the respondents of the public consultation: 73% of respondents addressed the availability of infrastructures as insufficient.

Cloud computing promises to reduce costs of ICT at schools, as it has done in other economic and societal sectors. Own servers are not necessary as the necessary cloud space can be rented according to the actual need. In addition to learning resources, cloud computing also supports both the academic and administrative services required in education and training systems. The privacy issues can be overcome by careful selection of private, public or hybrid cloud and appropriate security protocols. Cloud-based infrastructure allow students and educators to access the same learning resources from different Internet devices anytime and anywhere, both in and out of school.

Example 11 - Finland[129]

In Finland the National Board of Education is set to establish a new data cloud service offering schools children and parents access to educational resources. The board aims to improve students’ ability to bridge the "digital divide". Educational resources would be available via the service for schools and pupils across the country. The goal is to ensure all students start from the same point in using information technology.

For real connectivity each student will need a connected device, which evidently represents a cost, either for the public budget or for families. However, many ways to license or rent these devices exist to suit diverging requirements, and often the cost of the device can be offset by reduced need to acquire other traditional educational material.

In higher education, institutions have realised relevant investments to respond to students' needs like Wi-Fi access everywhere in the campus or a full range of Internet services and tools[130], but students generally follow the "Bring Your Own Device" approach. This trend is also gaining foothold in primary/secondary sector, as effectively students own devices represent an unused resource, more often banned than used for learning. The general concerns of inappropriate use of devices,  what is accessed by them and when, can be overcome, on one hand, with clear policies regarding the use and, on the other hand, through filtering of the content by the educational institution itself.

2.3.3.2.  Open standards and interoperability are crucial for innovation and adoption new technology in learning[131]

We are all surrounded by digital systems that rely on well-functioning technical standards that have become transparent: we talk about the internet, not TCP/IP; about the world-wide web, not HTML; about mobile phones, not WAP and 3G. What do not work so well (and in many cases do not even exist) are the technical standards specific to learning – and in particular to learning in formal, school environments. In fact, often the problem is not the identification of suitable standards and specifications, but the adoption of these standards and specifications and their application in practice.

Standards for interoperability, so easily just dismissed as “technical matters”, are in fact crucial to the future of learning. Appropriate interoperability standards allow software applications to integrate with third-party tools, creating synergies, extending functionality, and supporting flexible markets. Interoperability standards play a crucial role in systems integration and content sharing in the education sector.

There are many formal standards bodies that have become involved in educational technology standardisation, including IEEE, the International Standards Organisation (ISO) and CEN Information Society Standardization System (CEN/ISSS). There are also other user led bodies who are driving the development of specifications, including the Department of Defence's Advanced Distributed Learning programme (ADL) and the IMS Global Learning Consortium. Those formal public standards (FPS) bodies are committed to achieving educational technology interoperability standards in areas such as metadata, content, administrative (enterprise) systems, and learner information.

However, the development and implementation of specifications and standards is not a simple and straightforward process. The stakeholder’s interests may conflict at different stages of the standards development life cycle, and the standardisation process itself may result in conflicting issues. Several issues and barriers which prevent the development and adoption of specifications and standards and hinder technology innovation include complex and inflexible standardisation processes; lack of inclusiveness in the process of developing and adopting specifications and standards; lack of consistent approach to allow multi-stakeholder collaboration and participation; lack of early implementation of specifications; and lack of ability to create derivative works.

Institutionalised specification and standards development can hinder participation, limit quality, impede innovation, restrict agility and lead to unnecessary costs. On the another hand, a huge range of social software tools have been developed, and adopted enthusiastically by users, which do not require support for slow-moving and possibly complex standards, and this suggests an ever increasing challenge to established standards bodies and consortia.

In order to support educational technology innovations there is a need for the development and adoption of specifications and standards that are less formal, less governed and aligned more closely with agile development models. There is a growing demand that the process and production of specifications and standards should be more “open” from developers, users and implementers in the technical community that have grown up with the web. Open markets can stir the innovation needed to create innovative educational technology. The quality of specifications and standards rely on the transparency and openness of their development procedures.

Countries like South Korea for example, early adopters in ICT for education and training and very competitive in the ICT domain, have understood the importance of having formal standards, so that systems can work with each other and quality can be assured[132]. The e-Textbook standardisation on global scale is a topic of intense debate also in the EU, as evidenced by the eTernity initiative[133].  The public consultation also underlined the need to provide for interoperability and open technical standards. Pearson, the world’s leading learning company, emphasised that the "role for the EU in developing a set of technical standards will be extremely useful for industry. (…) This activity will ensure that no one player concentrates the market by introducing their own set of standards for how open resources are assessed, made available, traded and marketed". Some standards have been tried in Europe, but remained national, like the Finnish Metadata standard (FinnEduMeta)[134], used for some of the resources available on OER portals in that country. In other countries like France, there is no single metadata standard used by all repositories: the French country analysis shows that at least five different ones apply.

These problems in development and adoption of open standards and interoperability represent a barrier to develop, use, re-use and share resources, and reduces the possibility for the private sector to exploit economies of scale, hampering innovation. The problem of interoperability standards affects all education and training forms and sectors. The Commission cannot solve the issues of standards and interoperability, but it can foster transparency and adoption by providing support to stakeholder collaboration.

3.           Consequences for the EU

Highlights Without adequate action in the EU, the current problems of uneven availability of infrastructures, difficult discoverability of quality digital resources, difficult validation of skills acquired online, etc. will continue to be reproduced. This has negative implications related to digital skills, digital divide and access to knowledge, inefficient use of resources and Europe's leadership. Education and training systems do not provide the digital competences needed in the 21st century economy and society. Europe will not provide similar opportunities to all its citizens to acquire digital skills for employability as well as active citizenship. The European economy would keep on facing digital skills gaps. There is a risk of increasing the digital divide between digital competent people and those who do not have such ICT skills. This is particularly relevant in terms of access to knowledge. The current gaps between countries may increase even more. Some countries would continue to make efforts for exploiting the potential of digital technologies for learning, while others would reduce or even stop them. This is likely to increase the negative impacts in terms of social cohesion, competitiveness and efficiency of resources. The efficiency potential of new technologies, evident in all economic sectors, is not reaped off in education and training, which lead to an inefficient use of educational resources. Europe will not be able to catch up with the emerging digital phenomena in education and training across the world and be able to modernise its education systems in terms of equity, quality and efficiency. Europe will be lagging behind in terms of supply of OER and emerging digital markets compared to the US and Asia. Third countries will lead the emerging digital phenomena in the education and training field (e.g. MOOC) and better exploit the potential of new technologies and of the investments already done. The EU would be just a follower, losing opportunities and increasing its dependency on educational technologies designed and produced abroad.

Due to the many obstacles that have to be tackled and with the current economic and financial crisis, there is a significant risk that Member States are discouraged in moving forward in integrating digital technologies and content, including OER, in their education and training systems. This would reproduce the current problems: uneven availability of infrastructures, difficult discoverability of quality digital resources, un-adapted and fragmented legal frameworks for an innovative use of educational contents, difficult validation of skills acquired online, etc.

3.1.        Lack of digital competences for employability

The lack of integration of new technologies in the mainstream teaching and learning practices implies that digital competences necessary for the current economy and society are not being fostered and developed. European industry is facing digital shortages and ICT-skills gaps in different sectors and expects this trend to further increase. According to the Digital Agenda, there will be around 900,000 unfilled vacancies for ICT practitioners in Europe by 2015.

Several actions to reduce the e-skills shortages, mismatches and gaps have been formulated at European level over the last few years under the European e-skills strategy (2007)[135]. Furthermore,  a ‘Grand Coalition for Digital Jobs’ was launched by the European Commission in early March 2013.  Some of the actions of the Grand Coalition are explicitly targeted towards  increasing the number of ICT graduates and professionals through different activities directly addressed to students, reducing the rate of university drop-outs in ICT and STEM studies and making more intensive use of industry-based training and certification .

Over the past few years the number of ICT graduates has steadily been declining every year, and demand is by far outstripping supply. The numbers of ICT graduates have shown a decline since 2006 while the e-skills demand increased and reach a substantial demand potential and number of vacancies for new ICT jobs until 2015 ranging between 372,000 and 864,000. As a consequence the e-skills gap will widen.

As such, it is projected that by 2015 the number of vacancies for ICT jobs in the EU will have grown to between 372,000 and 864,000 depending upon the scenario. As a consequence the e-skills gap will widen.

Furthermore, the Digital Agenda estimates that by 2015, 90% of jobs will require at least a basic level of digital skills, while in 2012, 49% of the European population had low or no digital skills, according to Eurostat.. Education has thus a crucial role to assure that all learners have the necessary digital skills for employability[136]. Real integration of ICT in education and training institutions will increase the digital skills of the population and contribute to the transformation and digital regeneration of people and society, with positive impacts on competitiveness and growth[137]. Public savings associated with putting these citizens back to work are of great importance.

Digital competences, one of the eight key competences for lifelong learning[138], are more than just functional or operational ICT skills. They refer to the skills, knowledge and attitudes required to use new technologies in a critical, collaborative and creative way.  In fact, in a study just published by JRC IPTS, on behalf of the European Commission, 21 specific competences have been described that constitute a framework for digital competence, emplacing critical, collaborative and creative ways of using digital technologies.[139] The concept of "digital natives" and the assumed high level of ICT skills acquired by young people at home are contested by international research (see section 2.1.). This shows the importance of integrating ICT into education.

3.2.        Digital divide and access to knowledge

The level of digital competences varies substantially according to age, education levels and gender. Therefore, increased access to digital technology risks also to increase the digital divide if not provided equally, particularly in terms of access to knowledge on digital skills – and learning with them. This "digital divide" - between individuals but also between countries and regions - is increasing in Europe.

The digital divide also affects active citizenship, as e-government practices are more and more widespread. Eurostat provides biannual data on self- declared computer skills[140] of 16-74 year-olds in Europe through their Community survey on ICT usage in households and by individuals. In 2011, the "high level" varied between 43% (Finland) and 10% (Romania). In 2011, only 53% of the labour force felt confident in their computer and/or ICT skills if they were to look for or change jobs, yet the figures drop to below 40% in several countries such as Greece, Italy, Cyprus, Lithuania and Romania. The level of digital competences varies substantially according to age, education levels and gender.

Figure 15: Percentage of individuals aged 16-74 with low, medium and high computer skills. 2011[141]

There is a clear generational and educational divide in computer skills. 45% in the age group 16-24 have high computer skills compared with 31% and 10% in the age groups 25-54 and 55-74. Computer skills are positively correlated with educational attainment in all the age-groups, with the difference in skills between lowest and highest education attainment level being most pronounced in the 25-54 age group.

The digital divide has consequences in terms of citizenship and access to knowledge. For example, e-administration practices are more and more widespread. Without access to Internet and a minimum level of digital competences, a citizen can be confronted to administrative difficulties. Moreover, Internet is already the field of political debates, as shown in the US' presidential elections or in the Arab Spring. At a time when knowledge is easily available through the Internet, the impact of the digital divide goes far beyond the mere use of digital tools. It creates a strong gap between those who are able to increase their knowledge through ICT and those who cannot.

3.3.        Inefficient use of resources

National policies on ICT in education and training are fragmented and very often financially unsustainable. The investments of European public authorities (e.g. € 487 million only in the UK between 2009 and 2010[142]) to create infrastructures and provide training to teachers, rarely reached the expected uptake and have not led to radical improvements in education.

Evaluation of EU's educational programmes reported that impacts were positive at micro level (for participants), but they just had moderated strategic effects (at country and European levels). The programme is not always matching the goals of ICT integration and mainstreaming in education systems[143]. EU's financing could be more efficient if based on a strategic approach, and the same conclusion could be extrapolated to several Member States and regions.

In addition, Member States are rarely exploiting the expected potential of OER for reducing public and private costs of education and training, even if in some like Spain, Portugal, Italy or Ireland, the cost of textbooks is becoming a real challenge for families.

In the current economic climate, cost-effectiveness, productivity and the need to do more with less are imperative in nearly every sector. Education and training is not an exception, as financial cuts in several EU Member States shows[144].

The efficiency potential of ICT, evident in all economic sectors, is not reaped off in education and training, which lead to an inefficient use of educational resources both at collective and individual levels. Digital technologies can improve effectiveness of resources through economies of scale, expanding access to a wider number of people at lower costs or allowing teachers to focus on what they do best by automating or offloading more routine tasks. New didactics linked to a stronger usage of ICT may lead to significant gains in educational productivity[145].

Box 3: "Today, Bolton – tomorrow, the world"[146]

Bolton's Essa Academy has undergone a technological revolution envied by schools across Britain and is considered amongst the most technologically advanced state school in the UK. Essa is a 900 pupil 11 to 16 school, taking most of its pupils from disadvantaged communities in the town. Its predecessor was deemed to be a failure by Ofsted, but it is now flourishing, after a remarkable shake up in the way pupils are learning. The new method of learning has acted as a catalyst in improving results: last year every pupil achieved five A* to C grade passes at GCSE, compared with 40 per cent previously. Technology decisions in Essa have been made with strict concerns of the cost, as they believe that thousands of pounds have been spent in schools and used really unwisely. Every pupil has their own iPod Touch or iPad, and teachers have their own iPads on which they can create mini textbooks for their subjects. The school has no offices, all staff communicates through hand held mobile devices. The creativity that has been inspired by the use of this technology has been phenomenal. Staff and students are able to have seamless communication that allows learning conversations to develop and feedback to be of a higher quality as well as the delivery of a personalised curriculum.

According to the British Educational Suppliers Association (BESA), ICT spending by UK schools rose to €286 million, an increase of 2.1% compared to 2011. Primary schools spent an average of €17,416 on ICT (plus 2.3%), while secondary schools spent an average of €77,444 on ICT (plus 1.9%)[147]. Such investments may not always give the expected returns in the short-term and their sustainability is at risk in times of economic crisis. For example, the Spanish programme "Escuela 2.0" launched in 2009, aimed at implementing the digital classrooms of the 21st century, was cancelled in 2012, despite positive evaluations in terms of quality of teaching, pupils' motivation and methodological changes[148]. In the meantime, investments for this programme represented around €200 million per year and hundreds of thousands of laptops were distributed.

Costs of education are rising worldwide. In the US, 43% of 25-year-olds had student debts in 2012. Nearly 18% of borrowers now have student loan debts of €19,300 to €38,600, and around 4% have balances greater than €77,200[149]. This so-called "student debt crisis" has its roots in state cuts to higher education that began in the 1980s. Several Member States are living similar situations, combining financial cuts and increasing university fees. Even access to educational materials like textbooks is becoming an issue for families in countries like Italy, Spain, Portugal or Ireland, as it is the case for years in the US[150].

In the meantime, OER, Open Courseware (OCW) and MOOCs become more and more widespread and demanded worldwide. In economic terms, they represent a unique opportunity for public and private savings. Just for the State of Washington, it is estimated that using state-adopted Open Course Library materials could save €30.9 million per year[151]. Unsurprisingly, in the US, OER are a key component of the Obama administration's Technology Plan and 2020 Graduation Goal.

In fact, the development of alternative digital forms of learning is a real necessity. Research foresees that in the next decades the level of worldwide demand for doing university studies will largely exceed the capacity of existing systems, not being economically viable to build enough new universities. The magnitude of unsatisfied demand indicates that concepts like online higher education are becoming a real need[152].

3.4.        Losing worldwide leadership

Europe is lagging behind in the exploitation of opportunities coming from new phenomena like OER and open practices, with a negative impact on its innovation capacities and its leadership in the global context. While major worldwide universities are offering open courses (e.g. MIT, Harvard, the UK Open University), MOOCs are developing very fast[153] and the use of OER starts to be promoted at institutional and political levels, Europe is only a follower of these emerging trends: in most European universities the emergence of MOOCs is not discussed and there is a lack of even further information on this issue, as stated by 85% of respondents. Several positive exceptions exist though, e.g. the UK Open University[154], German MOOCs[155] or to get European MOOC providers together[156].

Meanwhile a major educational technology market is emerging worldwide. This market is expected to grow up to 20% by 2016 due to public-funded education policies that deploy digital learning infrastructures, large scale digitisation efforts by governments and the academic sector, explosive development of digital learning content, ICT investments of the educational industry and content providers, demand services, rapid growth of online student enrolments, amongst others[157]. Innovative research techniques based on collecting and analysing learners' data (learning analytics and educational data mining), allow the development of new pedagogical approaches, based on a better understanding of students needs and what works well from the didactic point of view.

Europe depends mainly on ICT infrastructures and technologies designed and/or produced abroad, with some exception market niches like interactive whiteboards. However, even though European market is currently small and fragmented nationally, it could potentially be a source of bigger growth, if exploited properly, supported with right market initiatives[158] and relying on Europe's leading edge pedagogical excellence.

4.           Ways forward for systemic innovation: examples of best practices

Highlights Over the past years several large scale pilots have been implemented across Europe, crossing national countries and even some European-wide. These pilots have as objective to be a test case for future large scale implementation in real practices. By analyzing the various ways these pilots are implemented, with or without success, one can learn more about the underlying conditions for successful uptake and use of ICT and OER in education and which concrete problems have to be tackled. The best practices described are very diverse in terms of targeted educational sectors; number of learners and teachers involved; geographical coverage; oriented on practices or on educational resources, etc. The following best practices in Europe have been looked into: One-to-one learning initiatives providing every child or teacher with a personal device; eTwinning, a European-wide community of schools; large scale experimentations providing real-life laboratories of scale to develop and test scenario's for mainstreaming innovative use of ICT in education; Open Courseware; Massive Online Open Courses changing the European higher education landscape and large-scale platforms for open education.

This chapter also looks into best practices of systemic uptake of ICT and open educational resources (OER) in education on regional, national and/or European level such as the one-to-one learning models; a European wide community of schools - eTwinning; large-scale policy experimentations; MOOCs changing the higher education landscape; Open Courseware in universities; European-wide platforms for open education, etc.

4.1.        One-to-one learning initiatives in Europe [159]

Until 2000, ICT in Education strategies launched across Europe aimed at a general push of technology, mainly desktop computers, into schools. During the past decade, a number of initiatives in several EU countries were initiated by national/regional governments, which focused on 1:1 computing providing every child or teacher with a personal device. The One Laptop Per Child initiative (OLPC), started supplying pupils in developing countries with affordable laptops in 2007, might be the most well-known programme, attracting considerable international attention and inspiring the emergence of others initiatives based on low cost digital devices[160].

The 'Netbooks on the Rise' report by European Schoolnet[161] identified two waves of expansion in Europe: the first wave mainly focused on spreading out computers and equipment at schools/classrooms level with the objective to ensure a wider provision of ICT and reduce considerably computer per pupil ratios, i.e. one netbook per learner. The second wave increasingly aimed to fulfil educational goals, such as the use of ICT in all subjects to foster competence-based education and personalisation of learning.

A more recent JRC IPTS study[162] identified in 2013, 31 recent one-to-one  learning initiatives launched since 2008 in 19 European countries, equipping all students of a given school, class or age group with a portable mobile computer device. The majority of these initiatives are integral part of national/regional ICT programmes launched by education authorities in order to promote school innovation. Most of these initiatives, even when implemented at regional or local level, are significant in scale, i.e. involving a large number of students (e.g. about 600,000 in Spain and Portugal or intended 15 million in Turkey from 2013 onwards) and /or equipping all schools across the entire country (e.g. 2086 Grade 1 public schools in Georgia). Overall, identified initiatives on 1:1 learning cover an estimated number of approximately 46,900 schools and 17,480,000 students in primary and secondary education (K-12) across Europe with the vast majority coming from Turkey (15,700,000), Spain (635,000) and Portugal (600,000).

The following figure shows the geographical distribution of 1:1 learning initiatives per country (the first number indicates the initiatives; the second one indicates the schools involved; values in brackets indicate the estimated number of students). The 'Acer-European Schoolnet Educational Netbook Pilot' ran in parallel in six countries.

Figure 16: Geographical coverage of recent 1:1 Learning initiatives in Europe[163]

The objectives pursued in these more recent initiatives are much more pedagogical and educational change driven.

Figure 17: Objectives tackled by the 31 recent 1:1 initiatives

Main Objectives of recent 1to1 Learning || No. of initiatives || Initiatives by country[164]

Innovate classroom and learning practices || 7 || UK, AT, IT, FR, DK

Implement 1:1 pedagogy || 9 || EU, ES, PT, SK, SE, IT, CZ, DE, DK

Improve students’ learning outcomes || 4 || UK, SE, IE

Improve students’ ICT skills and motivation || 7 || AT, FR, GE, ES, DE, CZ

Improve access to quality educational resources || 3 || DK, NO, TR

Foster anytime-anywhere learning opportunities (school & home use of the device) || 12 || AT, ES, CY, EE, FR, UK, EU

Increase ICT provision in schools || 8 || EL, FR, LT, TK

Provide access to (advanced) ICT equipment || 4 || CY, DK, LT,

Improve communication between students, teachers and parents || 5 || AT, CZ, EU, FR, ES

Support leadership development || 1 || DK

Reduce the digital divide || 5 || CY, IE, LT, FR, PT, TK

Collect hands-on experiences /evidences || 3 || AT, LT, EU

Overall, 1:1 learning initiatives in Europe can be considered as incremental, moving progressively to more radical approaches where the emphasis lies on 1:1 learning rather than 1:1 devices. 

It is interesting to note that about half the 1:1 initiatives have already reached a significant scale, involving a large number of students (e.g. 180,000 in Norway and 113,226 in Greece) and are moving towards mainstreaming (e.g. 600,000 students in Portugal, 634,549 in Spain and 15,700,000 in Turkey). Five initiatives (i.e. in Georgia, Greece, Portugal, Spain and Turkey) are system-wide implemented, being part of a mainstreaming programme (with the equipment gradually provided to schools in the whole country).

More than half of the initiatives are embedded in regional/national strategies, but only one initiative was cross-border, involving learners from six European countries (i.e. ACER-EUN). Pilot projects carried out at local/regional level, as well as across a whole country (i.e. system–wide pilots such as in Estonia, Cyprus, Austria, Italy, Norway) were implemented in the first place before being eventually scaled-up during a second phase of the project (with more devices given to more students in the same school, at different education levels and/or to other schools in other regions). As shown in Figure xx, several initiatives have also been piloted on a smaller scale before being up-scaled, and in some cases even mainstreamed (highlighted in red).

Figure 18: Scale of innovation of recent 1:1 learning initiatives in Europe

The key outcome achieved to date by recent 1:1 learning initiatives in Europe is an increased attention and impact beyond the technology itself, including professional development, involvement of parents and school community. Although the type of adoption varies across schools and, within a school, across teachers, innovation supported by 1:1 computing affects students’ learning and motivation, 1:1 pedagogy, teacher professional development, and partnership and collaboration with the community. 

However while the 1:1  learning models aimed to enhancing the uptake of ICT in learning and teaching processes by offering each learner its own device, most of the initiatives did not go further than offering just the infrastructure and tools, and some teacher guidance and professional development. Incremental changes in the teaching strategies and pedagogical scenarios applied were less common. Again impact analyses of one- to-one learning pilots show that real impact and full implementation of ICT in education, requires holistic approaches whereby all educational elements are being tackled at the same time within an overall vision and a full engagement of all stakeholders. It often requires also innovative individuals that provide the vision for the others.

4.2.        eTwinning – A European wide community for schools[165]

    eTwinning (www.etwinning.net), the European Commission initiative for a schools’ community in Europe, is recognized by practitioners and stakeholders as a successful European ICT-enabled innovation that contributes to the modernisation of education and training in the EU[166].  Running its ninth year of development, eTwinning can be considered as a successful and stable ICT-enabled innovation for learning with good prospects for further development directed both towards improving and deepening the experience of participating students, teachers and schools and towards strategies for expanding its existing reach and scale. 

eTwinning (May 2013) involves more than 200,000 teachers, head teachers, librarians, IT coordinators etc. (the so-called eTwinners) working in schools in one of the 33 European countries involved[167]. eTwinners can utilize the tools and the secure internet spaces offered for meeting virtually, exchanging ideas and practices, and engaging in cross-border projects using ICT. eTwinning also provides additional services to teachers including the search for partners for Comenius school partnerships[168], the opportunity of taking part in communities of practice (e.g. eTwinning Groups[169] and Teachers Rooms[170]) and professional development opportunities (Professional Development Workshops[171] ; Learning Events[172] - online and/or onsite - at regional, national or European level)[173].

eTwinning was launched in January 2005 as the main action of the European Commission’s eLearning Programme, and has been firmly integrated in the Lifelong Learning Programme since 2007 (see next Figure). It responds to the request made by the Barcelona European Council[174] in March 2002 to promote school twinning through the Internet as an opportunity for all students to learn and practice ICT skills and to promote awareness of the multicultural European model of society[175].

Figure 19: The timeline and milestones of eTwinning development

Numerous teachers' professional networks and communities of practice at national (e.g. the Internet en el Aula[176] in Spain) or cross-national level (e.g. the Commonwealth Class[177], the TES network[178]), contribute to teachers' professional development and facilitate peer-to-peer learning and collaboration. eTwinning is considered as the most sustainable and widespread educational network in Europe as well as a concrete case of on-going ICT-enabled innovation with significant impact on education and training for the following reasons:

· It is a fast-developing initiative that has a stable organisation schema and funding, a constant development, and sustainability/scalability plans in place;

· It allows new possibilities for school staff and students to connect with multiple actors (e.g. peers, external experts, wider community) opening up alternative channels for gaining skills and knowledge and broadening their horizons;

· It utilizes social networks mechanisms for enhancing collaboration, communication and intercultural awareness among the school community in Europe;

· It supports teachers' peer learning and continuous professional development -through their active participation in collaborative projects, communities of practice and various face-to-face and online training activities;

· It contributes on the development of teachers' professional skills in ICT-enabled innovative pedagogical practices and thus accelerates educational change[179].

Now in its ninth year of development (2005-2013), eTwinning is recognized by practitioners and stakeholders as a well-established teachers' network, with a stable organisation schema and sustainability/scalability plans in place. The European Commission intends to reinforce the role of eTwinning in the context of the new "Erasmus+ (the EU Programme for Education, Training, Youth and Sport” for 2014-2020). eTwinning will become the basis for all European school cooperation activities. The expanded eTwinning will offer an upgraded Internet platform, more online professional learning activities for teachers and more opportunities for collaboration with schools outside Europe.[180].

eTwinning Plus and the international dimension of eTwinning eTwinning Plus is a pilot for the partial extension of eTwinning to some countries of the Eastern Partnership (Armenia, Azerbaijan, Georgia, Moldova and Ukraine) and South Mediterranean (Tunisia). It got off to a very promising start in the first quarter of 2013. Albania, Bosnia-Herzegovina, Montenegro, Kosovo and Serbia could join eTwinning in the near future. Other countries could be involved to a lesser extent through ad hoc collaboration agreements.

On 15 April 2013, 200,138 teachers and other practitioners from 104,567 schools in 33 countries (the 27 EU member states plus Croatia, Iceland, Norway, FYROM, Switzerland and Turkey) have been registered in eTwinning; 14,743 of them are involved in projects registered after 1.6.2012. In terms of projects, 5,768 are currently active and 21,970 closed[181]  whereas the average ratio of registered ‘user’ per school is 1.96. According to the estimations by Wastiau, Crawley & Gilleran (2011), the participation in eTwinning projects over the first six years of its development (2005-2010) must have involved close to 750,000 students across 33 countries in Europe.

However, although these figures are constantly increasing[182] (see figure below), the eTwinning action currently reaches on average 3.3% of the potential teaching population within the participating countries. Therefore, according to Rogers’ model of diffusion of innovation (2003), eTwinning in most countries still remains limited to teachers who are “innovators” in using ICT for cross-border school collaboration[183].

Figure 20: eTwinning statistics

                                                                    

On the other hand, based on calculations regarding the number of schools present in each country, it can be seen that the coverage of schools (up to 25%) is much higher than the coverage of teachers. This in turn could potentially provide an opportunity to increase the eTwinning teachers reach[184] through local dissemination as even the most experienced eTwinners still tend to work in relative isolation within their schools (European Commission, 2013). Recently, the idea of School Teams, namely any group of teachers, librarians, head teachers etc. within a school who are involved in eTwinning, is promoted by eTwinning as a way to increase its reach through local dissemination[185]. In summary, a wider take up is needed to move eTwinning from its current scale phase into the mainstream one having an impact at a systemic/organisational level.

Based on the success of European platforms such as eTwinning for schools cooperation and in line with the Council Resolution on a Renewed European Agenda for Adult Learning in Europe[186], the European Commission  is launching a multilingual platform for adult learning in Europe in order to further the quality of adult learning in Europe through the internationalisation of adult learning organisations, the professional development of adult learning staff and enhanced cooperation between policy makers involved in adult learning. The platform will offer a central location for information and resources on adult learning and a space for cooperation, peer learning and sharing of best practices between all adult learning stakeholders in Europe. Such a platform will be of particular importance for the field of adult learning given its varied and disparate nature and the existing differences between countries in the performance of their adult learning systems. The future platform, EPALE – Electronic Platform for Adult Learning in Europe will address these challenges by creating a common reference point for adult learning in Europe.

4.3.        Large-scale policy experimentations

One of the problems identified to scale up pilots is that all educational stakeholders need to be engaged in the project. In particular two-ways interaction between the policy, practice and research has to take place. The concept of 'Living educational labs' is looking into this and various EU-wide projects have been recently launched with much success.

   For example, within a school setting, the iTEC (Innovative Technologies for Engaging Classrooms) project provides a laboratory of scale in which to develop and test scenarios for mainstreaming innovative use of ICT in schools in Europe. iTEC (2010-2014) is a major EU-funded project in which European Schoolnet is working with education ministries, technology providers and research organisations to bring about transformation in learning and teaching through the strategic application of learning technology.

With 27 project partners, including 14 Ministries of Education, and funding of €9.45 million from the European Commission’s FP7 programme, iTEC is a flagship project for the design of the future learning environment in compulsory education. The iTEC project particularly addresses the growing concern of Member States and the European Commission that innovative use of ICT in schools and scenarios for the future classroom must now move beyond small-scale pilots and really be taken to scale. Currently, therefore, iTEC is piloting learning and teaching scenarios for the future classroom in >1,000 classrooms in 15 countries, making it by some margin the largest pan-European validation of ICT in schools yet undertaken. Evaluation is an integral part of the cycle assessing the potential of the iTEC learning activities and identifying supporting factors and barriers.

 Another example in the school education area is the Living School Lab aiming to establish a pan-European network of ‘living schools' demonstrating and showcasing a diverse range of innovative pedagogical practice involving ICT. Started in October 2012, Living Schools Lab is a two-year project funded by the European Commission and coordinated by European Schoolnet. It includes 12 Ministries of Education and aims to create:

· A sustainable pan-European network of ‘living schools’ demonstrating and showcasing a diverse range of innovative pedagogical practice involving ICT and sharing best practice and ways to successfully embed the use of technology in teaching and learning across the whole school.

· To identify successful strategies for taking change management to scale – moving from a single class to ICT being embedded across the whole school.

· A strong community of practice, with supporting continuous professional development opportunities for teachers.

· Opportunities for schools to get involved in action-based research, creating links with outside partners including industry and other pan-European projects.

· To create a strong community of teachers, with access to continuous professional development to help them with changing pedagogical practice.

There is another launch for the European Living Learning Network by schools and for schools. It is a facilitated grassroots initiative initially formed from school networks in 6 European countries and partnerships abroad including schools in developing countries. Linked to a facilitators network of higher education institutions, thematic organisations, experts, learning content and technology providers, we.learn.it schools will be enabled to co-develop and embark into Learning Expeditions jointly with leading players in European science, creativity and innovation. It will intensify the collaboration of schools with Europe's higher education institutions that are at the forefront of European innovation in learning organisational models and pedagogical concepts, in particular the experiences of Aalto University in Finland - today considered a leading European case with new learning models like Design Factory and Aalto Entrepreneurship Society.

The Future Classrooms Lab (CCL) (http://fcl.eun.org/) led by EUN. It involves nine Ministries of Education in Europe or organisations delegated to act on their behalf (AT, BE/FL, BE/FR, CZ, IT, LT, PT, SI, UK), who will work closely with five leading ICT vendors (Acer, Microsoft, Texas Instruments, Samsung. SMART Technologies as Associate Partners). The aim of the experimentation is to develop coherent strategies to ensure that whole-class implementation of tablets can support innovative 1:1 pedagogies and teaching approaches (involving personalized learning, collaboration, interactivity, etc.) and be integrated in national programmes. The project makes a clear link between existing large scale research (iTEC) and the implementation in national programmes.

The Future Classrooms Lab is one of the projects using a new instrument introduced in 2013 under the Lifelong Learning programme called policy experimentations supporting trans-national co-operation through large-scale experimentation, joint policy development and exchange of good practice and innovation.  The focus is on support to national, regional and local authorities in mainstreaming the use of new technologies in their school educational policies and practices through policy experimentations with 'Creative Classrooms'. ‘Creative Classrooms’ are conceptualized here as innovative learning environments that fully embed the potential of ICT to innovate learning and teaching practices. The term ‘creative’ refers to the innovation of learning and teaching processes through technologies (e.g. collaboration, personalisation, entrepreneurship, etc.). Likewise, the term ‘classrooms’ is used in its widest sense to include all types of learning environments: formal, non-formal and informal.

Mainstreaming EU Classroom Portfolio's

(http://www.eportfolio.eu/project) is another policy experimentation under the Lifelong Learning programme led by the Ministry of education of Ireland with 12 other countries. The aim of the project is to design and test innovative ePortfolio models which will inform and support the implementation of innovative learning environments using ICT across Europe. The emphasis is on learning from the practical implementation of ePortfolio's in schools. The project helps policymakers draw valuable real-world lessons in order to deepen the use of ICT (specifically the portfolio approach) in teaching, learning and assessment.

In all of the above described projects looking into conditions of success for a larger implementation of ICT in education, the balance and interaction between bottom-up and top-down initiatives is a common feature. Educational authorities from different participating countries identify together a common challenge related to mainstreaming the use of ICT in educational practices and build a partnership addressing this challenge. The concept agreed upon by the trans-national partnership is tested ("policy experimentation") at national level in real-life learning environments, in one or more of the partner countries, in a representative sample of schools. The results of the experimentations around the use of ICT in education are evaluated first at country level and then collectively with the other partner countries, with the systematic involvement of scientific experts. Policy experimentations achieving successful results - according to scientific evidence and policy evaluation - will prompt responsible authorities to introduce changes in the education systems/curricula and foster large-scale implementation.

4.4.        Open Courseware

Open Courseware (OCW) is one particular form of organising Open Educational Resources, presenting them as a complete set of materials needed for an entire course. These may include a syllabus, different forms of presentation of the content (using video, text, presentations, etc.), exercises, assignments to be performed by students and exams or other forms of assessment of learning outcomes. The Open Courseware Consortium[187] defines: «an OpenCourseWare is a free and open digital publication of high quality college and university level educational materials. These materials are organized as courses, and often include course planning materials and evaluation tools as well as thematic content. OpenCourseWare are free and openly licensed, accessible to anyone, anytime via the internet. »

Open Courseware is a more structured concept than OER as the latter may refer to each of the individual elements of one OCW and not to the entire set.

An OpenCourseWare course is with:

- a joint start and end time;

- interactive user forums;

- assessment and (informal) certification.

Given its principles of open availability and freedom of adaptation by others, open courseware has been an important tool through which education openness has been promoted. The main higher education institutions providing OCW are represented in the Open Courseware Consortium which currently serves as an access point to OCW being provided by its members in their own platforms. Its portal indicates a total of 8760 full courses being provided there from 68 different sources spread over 20 languages[188].

Example 12 - Germany, Luxembourg, France, Belgium

'University of the Greater Region' project (http://www.uni-gr.eu/en/nc/home.htm) The University of the Greater Region project is an interesting cross border region cooperation initiative with programmes being composed of classes at different – geographically close – universities, which include Saarland and Rhineland Palatinate in Germany as well as the Grand Duchy of Luxembourg, the French region of Lorraine and Wallonia in Belgium. Over the next two years a cross border association of universities will be created. It will involve the universities of Saarland, Liège, Luxembourg, Lorraine, Kaiserslautern and Trier. The partner universities involved have a total of around 115,000 students and around 6,000 teachers and researchers. Teaching and research is in German, French and Luxemburgish (the three national languages found in the Greater Region) as well as in English. There is both physical mobility and access to shared materials on line.

Example 13 - Germany

The Virtual University of Bavaria (http://www.vhb.org) The Virtual University of Bavaria (VHB) promotes and coordinates the development and implementation of tailor-made online course offerings at Bavarian universities for students (for free) and others (low fee). Like its member universities, the BVU is financed predominantly by the Bavarian Ministry of Higher Education. The BVU provides online-courses with an equivalent of two to six credit points (by ECTS) which the member universities can integrate into their courses of study. The BVU helps its member universities to enlarge and enrich their programmes, and it helps the students to organize their studies in a more flexible way. The basic and most important working principles of the BVU are a focus on blended learning at the macro level of the course of study, not at the micro-level of the single course, lecture or seminar, giving priority to asynchronous forms of communication, thus facilitating the import and export of online-courses between all member universities, and the development and provision of courses tailored to the needs and the actual demand of the member universities, with an elaborate quality management, financing of the production of courses as well as the operation of these courses, especially the online-tutoring of students. Iversity (https://www.iversity.org) Following an 'EXIST'-Founder Scholarship from the German Federal Ministry of Science and Technology, Iversity received more than 1 million Euros in funding from the BFB (Frühphasenfonds Brandenburg (EU 75% / Brandenburg 25%) and bmp media investors in July 2011. In December of 2012 Marcus Riecke joined the team and invested in the company together with the existing investors, Masoud Kamali and T-Venture, the venture arm of Deutsche Telekom AG. The open course platform provides: (i) a structured course environment that features multimedia teaching materials, (ii) assessment features such as multiple choice and peer review in order to keep students engaged and provide them with quantitative and qualitative feedback and (iii) a discussion board where students can engage in peer-to-peer learning by asking and answering questions or sharing links, references and general observations.

4.5.        MOOCs are changing higher education

The “Open Educational Resources Movement”, advocating the free exchange of digital educational resources, has been most predominant at higher education level. The movement acquired its first momentum in 2001, when the Massachusetts Institute of Technology (MIT) announced the release of nearly all its courses on the Internet for free access. In 2002, UNESCO organized the First Global OER Forum/Forum on the Impact of Open Courseware for Higher Education in Developing Countries where the term "Open Educational Resources" was adopted. More recently, the concept of Massive Open Online Courses (MOOC) has appeared and currently concentrates the attention of literature and media.

Figure 21: MOOCS and Open Education Timeline[189]

The European situation is evolving in a fast way. While this Staff Working Document is written several European universities have started to be engaged in MOOCs.

Example 14 - Norway

The Norwegian Government has appointed a Commission to look into MOOCs. The committee will survey the emergence of MOOCs and similar offers, compile data and make recommendations on how the Norwegian authorities and institutions shall relate to the development and the opportunities such education provides. The Committee shall submit an initial report by the end of 2013. The Committee has been given the task of compiling a more detailed report with specific recommendations in summer 2014.[190]

Example 15 - United Kingdom

Futurelearn Ltd (http://futurelearn.com/about) is an entirely new company launched by The Open University (OU) in December 2012. The universities of Birmingham, Bristol, Cardiff, East Anglia, Exeter, King's College London, Lancaster, Leeds, Southampton, St. Andrews and Warwick have all signed up to join Futurelearn, which is independent but majority-owned by the OU. Its aims are to (i) bring together a range of free, open online courses from leading UK universities, that will be clear, simple to use and accessible, (ii) draw on the OU's expertise in delivering distance learning and pioneering open education resources to underpin a unified, coherent offer from all of its partners, and (iii) to increase accessibility to higher education (HE) for students across the UK and in the rest of the world.

In May 2013 Copenhagen University has joined the still exclusive but quite rapidly growing group of European universities offering MOOCs, most of them through Coursera. École Polytechnique Federale, or EPFL, has been running successful MOOCs, notably in computer sciences and programming. It is with the EdX platform, launched in 2012 by the Massachusetts Institute of Technology and Harvard University. The University of Geneva is participating in Coursera. In Spain, IE Business School in Madrid and Autonomous University of Barcelona are participating in the Coursera consortium; in Italy it is La Sapienza in Rome; and in Germany the Technical University and Ludwig-Maximilian University, both in Munich. In the United Kingdom, the University of London and Edinburgh University are on the Coursera list. In The Netherlands, Leiden is participating in Coursera and the Delft University of Technology has joined the EdX platform (see box below).

Helsinki University developed and has been running several MOOCs in computer science on its own platform. Helsinki is also the only university that is giving credit for the computer language course SCALA.  They has now established a master project “MOOCs COCKPIT” that will help lecturers assess how their course is progressing, handling large and complex data with various scripting and visualising techniques. Together with Technical University in Munich, Technical University Denmark and Technical University Eindhoven, EPFL has established the EuroTechUniversity network aimed at developing a series of ongoing MOOCs covering green technology and the life sciences, targeting professionals with first degrees who are seeking additional qualifications.

And in the coming months several universities have announced more MOOCs (University of London , Munich’s Maximilian University, Autonomous University of Barcelona, La Sapienza in Rome (IT), Edinburgh University (UK), Leiden University (NL), Catholic University of Leuven (BE), etc.

EdX - http://www.edx.org

EdX is a non-profit organisation started by Harvard University and MIT in 2012. Other universities have since joined, including Delft University of Technology and the University of California (Berkeley). The aim of edX is to provide university-level online courses free of charge for people all over the world. With Coursera and Udacity, edX is one of the best-known providers of MOOCs. What distinguishes edX from the other two is its aim of providing educational resources subject to a Creative Commons open licence, and of making edX a platform for experimentation with e-learning.

Coursera - http://coursera.org

Coursera is a for-profit enterprise started in 2012 by Daphne Koller and Andrew Ng of Stanford University. On their website, they describe Coursera as follows: “We are a social entrepreneurship company that partners with the top universities in the world to offer courses online for anyone to take, for free. We envision a future where the top universities are educating not only thousands of students, but millions. Our technology enables the best professors to teach tens or hundreds of thousands of students”. Currently (June 2013), it offers 386 courses from more than 70 universities. All the courses are freely accessible, but the course material may not be freely reused by third parties. The revenue model for Coursera is based, amongst other things, on giving external parties paid access to student data, for example so that they can find the best candidate for a job vacancy.

The enormous interest in MOOCs comes exactly at the right time. Bricks-and-mortar campuses are unlikely to keep up with the demand for advanced education: according to a widely quoted calculation, the world would have to construct more than four new 30,000-student universities per week to accommodate the children who will reach enrolment age by 2025[191], let alone the millions of adults looking for further education or career training. Colleges and universities are also under tremendous financial pressure, especially in the United States, where rocketing tuition fees and ever-expanding student debt have resulted in a backlash from politicians, parents and students demanding to know what their money is going towards. MOOCs promise to solve these problems by radically expanding the reach of existing campuses while streamlining the workload for educators. European universities are using them to promote both centres of excellence and some of their most high-profile academics.

Figure 22: Downes’ comparative diagrams of interaction in traditional and networked online education[192]

Despite these various initiatives launched by European universities, one can state that Europe is still lagging behind and is trying to catch up with developments in other continents[193]. While major worldwide universities are offering open courses (e.g. MIT, Harvard, the UK Open University), MOOCs are developing very fast[194] and the use of OER starts to be promoted at institutional and political levels[195].

Europe is only a follower of these emerging trends: in most European universities the emergence of MOOCs is not an issue of discussion in their institution as stated by 85% of respondents[196]. According to the EUA survey, the very concept of MMOCs is unknown in one third of the 200 European universities consulted and just another third has internally discussed the topic. These data are disappointing if compared with the explosion in the US, illustrated by Figure 23.

Figure 23: MOOCs in Europe[197]

According to Gartner’s MOOC Hype Cycle[198] (Figure 24), almost the peak of the initial hype has been reached: platforms have been created, masses of MOOCs are being offered, certification systems are being put into place, and the list of applications is growing. But this does not mean that full exploitation and large scale implementation of OER in education has taken place. Such peaks, according to Gartner, are often followed by several years of disillusionment and maturity, a phase of correcting the innovation’s weaknesses, meeting challenges in order to produce a better product, and fine-tuning business models. Only after several years is the product fully mature and truly mainstream.

Most MOOC start-ups do not appear to have clear business plans and are following the common approach of Silicon Valley start-ups by building fast and worrying about revenue streams later[199]. Hill[200] describes a similar cycle: he believes that after their initial success, the current systems will have to resolve a number of urgent questions concerning their “revenue models, credentialing, badges or accreditation, course completion rates, and student authentication” before they can evolve. It is a mistake to see MOOCs as an isolated issue as they are part of a broader landscape of changes in HE that includes the development of open education improving teaching and opening up to different groups of students.

Figure 24: The MOOC Hype Cycle[201]

4.6.        Large-scale platforms for open education

To enhance the use, re-use and sharing of educational resources several projects are trying out to link up the diverse OER repositories and portals towards a European-wide platform.

School education

The Learning Resource Exchange is a federated access platform operating since 2008 and is run by European Schoolnet with the support of Ministries of Education. It provides an EU-wide platform and incorporates resources from over 50 content providers across Europe into its search results, thereby providing access to more than 200,000 resources. The LREs business model is to operate not as a centralised access platform but to provide a federated search architecture to which national repositories can link into. This allows users to access the search results via national websites or even a school’s virtual learning environment.  While on the one hand this is a key strength of the project as it provides EU-wide access from portals already familiar to the teacher, it is also, possibly, its greatest weakness. As teachers access the Exchange not via a centralised platform, limited “community building” in the form of sharing and collaboration has occurred.  This might explain the relatively low numbers of users of the Exchange.

Similar projects such as the OER directory currently under development at the eLearning Portal or the Open Discovery Space project (ODS) try to address these issues by focussing on a stronger integration with communities of users. Especially the ODS project incorporates a strong element of social networking of teachers in order to build a strong foundation for sharing resources. However, in the context of the scope of the challenge, these projects are only able to reach a certain number of teachers and learners. Therefore, the problem of a highly fragmented market for OERs is currently not sufficiently addressed.

Higher Education

Recently, there are several voices for a coordinated European platform to run MOOCs. The European Association of Distance Teaching Universities set up a European MOOC platform and SAP set up the Academic Cube, an online education platform with MOOCS for ICT professionals.

Partners in 11 countries have joined forces to launch the first pan-European MOOC initiative, with the support of the European Commission. Around 40 courses, covering a wide variety of subjects, will be available free of charge and in 12 different languages in the portal www.OpenupEd.eu, officially launched on 25 April 2013. The initiative is led by the European Association of Distance Teaching Universities (EADTU) and mostly involves open universities based in France, Italy, Lithuania, the Netherlands, Portugal, Slovakia, Spain, UK, Russia, Turkey and Israel.[202]

Courses range from mathematics to economics, e-skills to e-commerce, climate change to cultural heritage, corporate social responsibility to the modern Middle East, and language learning to writing fiction. Each partner is offering courses via its learning platform and at least in its home language. Courses can be taken either in a scheduled period of time or anytime at the student's own pace. All courses may lead to recognition: a completion certificate, a so-called badge, or a credit certificate that may count towards a degree. In the latter case, students have to pay for the certificate, with the cost ranging from € 25 to € 400, depending on the course size (the hours of study involved) and institution.

Academy Cube, which launched March 2013 an online education platform under development by SAP, a world-leading German software company headquartered, with offices in some 130 countries. Academy Cube is supported by the European Commission Digital Agenda programme and its objective is to tackle youth unemployment by providing jobless youngsters with IT skills via learning management systems. It is being developed by SAP with Microsoft, LinkedIn, Software AC, Thyssen Krupp, the German Federal Employment Agency and academic institutions, and they are discussing MOOC operations with the European Institute of Technology’s EIT IT-LAB, which is a high-priority European ‘knowledge and innovation community’.

EU eLearning portal[203]  (http://elearningeuropa.info )

The portal was created by the European Commission in 2002. It functions as a single point of reference for eLearning activities and resources in Europe, a European platform for co-operation, disseminating good and innovative practices, providing possibilities for debate and exchange.

It offers a common space for practitioners, policy-makers and members of academia, and serves as a reference gateway where top experts in the field identify and communicate about new trends. In 2012, the portal had more than 62,000 visits per month.

The portal shows many success stories, networks and centres of excellence in Europe upon which innovative strategies can be built to transform learning methods and boost creativity in schools, enterprises and society at large. The portal's scholarly online publication 'eLearning Papers' is rated the world's #1 journal in the field of ICT and learning.

5.           Concluding remarks: conditions for sustainability, scalability and impact[204]

Highlights

In order to overcome the existing implementation gap on the use of new technologies and open educational resources in Europe, the evidence calls for urgent action on the various underpinning conditions and this on all levels of policy making and practices, local, regional, national and European-wide. Based on the evidence base and best practices provided in this Staff Working Document, several conditions for successful uptake of ICT in education have been identified.

While clearly more research is needed on how we can develop, sustain, and further implement the existing initiatives of ICT-enabled innovation for learning, the best practices examples of the former chapter provide some ideas on possible conditions for sustained and scalable impact on learning to realise the potentials of ICT to support learning.

Eight main conditions enhancing mainstreaming of ICT use in education in terms of an innovation process have been identified:

1. Whole system approach: Successful scaling up and uptake of the use of new technologies and OER in education only takes place if it looks into learning and teaching taking a holistic and whole system approach whereby common vision, strategies and agenda is being defined and agreed upon by all stakeholders and all dimensions in the learning and teaching processes are touched upon (from content and resources, curricula, learning and teaching strategies; assessment, learning outcomes, etc.). Successful uptake is thus context-dependent and there is not just one-size-fits-all approach.

 

2. Organic development over time: Most of these practices of ICT-enabled learning innovations started as incremental efforts from a single pilot in one classroom, in a single school, to networks of schools across countries, etc., and progressively moved towards more radical forms of innovation, indicating that these initiatives have developed organically over time. The characteristics of these initiatives as well as their respective change strategies have evolved through interactions among the various actors and the many contextual factors. Their successes are clearly not a consequence of blueprints, but rather that dynamic adaptations and adjustments were continuously developed and implemented as an integral part of the monitoring, evaluation and feedback cycles, which is consistent with an ecological model of change. 

3. An articulated educational vision and roadmap: Successful scaling up only happens when the use of new technologies and OER is linked to a clearly articulated educational objective improving access, quality, and efficiency of education. A well-articulated innovation agenda and accompanying roadmap of implementation (business plan) should be developed by each educational organisation - which has both long-term vision (ensuring policy support) and achievable short term goals for the progressive take up of innovation.

4. Top-down and bottom-up should meet: Another common characteristic of these practices is that while most of these started as top-down initiatives within their respective contexts, they all have mechanisms in place to encourage and support bottom-up approaches to the innovation. While learning innovations may be initiated even at the classroom level by the teacher, impact at scale cannot be achieved without some higher level support as such innovations inevitably impinges on curriculum and assessment practices and requires access to technology infrastructure and support. One of the core conditions crucial to the scalable success of these initiatives is the deployment of top-down strategies to support bottom-up innovations. The presence and multiplicity of bottom-up strategies, whether centralized or decentralized, are indications of ownership from the bottom-up stakeholders. The challenge is to ensure that bottom-up innovations are well-aligned with the top-level goals and strategic focus of the entire project and not become as run-away developments that go off in many diverse different ways which may even be counter to the overall objectives. To ensure constructive alignment in strategic direction across the multiple levels and stakeholder groups, connectivity mechanisms and structures to serve as architectures for learning become another key strategic direction that needs to be considered.[205]

5. Develop support structures at a larger scale: Up scaling and integration of the use of new technologies and OER in education is not a matter of just multiplying the number of small scale pilots.  One has to facilitate the five steps of up scaling by Clarke & Dede[206] by specific support structures, such as:

- large (cross-regional, cross-national) network of ‘living schools’ demonstrating and showcasing a diverse range of innovative pedagogical practice involving ICT and sharing best practice and ways to successfully embed the use of technology in teaching and learning across the whole school:

- structures to encourage the development of professional networks for peer learning, knowledge exchange and sharing innovative pedagogical best practices.

- structures (such as national and/or transnational inter-linked portals; common reference frameworks; etc.) to aggregate all learning opportunities on a larger scale (national and even European and world-wide).

6. Empowering all stakeholders to collaborate and exchange knowledge: Research reveals that successful scaling up and uptake of the use of new technologies and OER in education only takes place if there is organized support to foster connectedness[207]  across and within different levels of stakeholders involved in the innovations to build trust, assure mutual objectives, and create a common vision.[208] Communication channels and platforms should be built to foster dialogue, communication and collaboration between all stakeholders (from policy, industry, research, educational practice and the wider public) involved and engaged in the educational process.

7. Elaborate the evidence base: Only when the use of new technologies and OER are felt and proven to have an added-value to the learning and teaching process, it will move towards a stage of full uptake. The evidence base has to be continuously enlarged, updated and communicated to the stakeholders.

8. Technologies as an important pre-condition: All the best practices have moved away from a technology-centric approach but still keep on investing in technologies, infrastructures and equipment as an underlying condition enhancing online learning. Despite the fact that broadband and extended Wi-Fi connections are still a concern in most of the EU countries and should be enlarged to ensure access and equity, the key technology is now becoming cloud computing with a focus on openness and connectedness.

To conclude: Based on the extensive analysis of the state of play of the use of ICT and OER in Europe, in-depth best practice cases at regional, national and European level and the possible conditions for successful mainstreaming of ICT and OER use, Europe has to take urgent action. Therefore the European Commission will propose a new EU-wide agenda for opening up education through new technologies and open educational resources.

              List of acronyms

ADSL:                    Asymmetric Digital Subscriber Line

BESA:                     British Educational Suppliers Association

CC:                         Creative Commons Licences

CEDEFOP:             Centre Européen pour le Développement de la Formation Professionnelle (European Centre for the Development of Vocational Training)

DG CNECT:            Directorate General for Communications Networks, Content and Technology

DG EAC:                Directorate General for Education and Culture

E&T:                       Education and Training

EACEA:                  Education, Audiovisual and Culture Executive Agency

EC:                         European Commission

ESF:                        European Social Fund

EU:                         European Union

FP7:                        European Union's Seventh Framework Programme’ for Research and Technological Development

HE:                         Higher Education

ICT:                        Information and Communication Technologies

IFPI:                       International Federation of the Phonographic Industry

IMS                        IMS Global Learning Consortium, originally (1997) from "Instructional Management Systems"

IPR:                        Intellectual Property Rights

JRC-IPTS:               Joint Research Centre – Institute for Prospective Technological Studies

LLP:                       Life Long Learning Programme

MIT:                       Massachusetts Institute of Technology

MOOC:                   Massive Open Online Courses

NGO:                      Non-governmental Organisation

OA:                         Open Access

OCW:                     Open Courseware

OECD:                    Organisation for Economic Co-operation and Development

OEP:                       Open Educational Practices

OER:                       Open Educational Resources

OMC:                      Open Method of Coordination

OPAL:                    Open Education Quality Initiative

PC:                         Personal Computer

PIAAC:                   Programme for the International Assessment of Adult Competencies

PISA:                      Programme for International Student Assessment

R&D:                      Research and Development

SCORM                  Sharable Content Object Reference Model

SIF                          Systems Interoperability Framework

TIMSS:                   Trends in International Mathematics and Science Study

UK:                         United Kingdom

UNESCO:               United Nations Educational, Scientific and Cultural Organization

US:                         United States

VET:                       Vocational Education and Training

VLE:                       Virtual Learning Environment

List of Figures

Figure 1: Conceptual map of the future of learning   8

Figure 2: An integrated vision and approach   9

Figure 3: Delivery of ICT learning objectives as recommended by central steering documents of MS in primary and general secondary education (ISCED 1, 2 and 3), 2009/10  15

Figure 4: Percentages digitally supportive schools in Slovenia   17

Figure 5: Percentages digitally supportive schools in Greece   17

Figure 6: % of Grade 8 pupils attending classes where teachers' use of ICT in more than 25% of lessons  19

Figure 7: Teachers use of ICT in Cyprus  19

Figure 8: Teacher's use of ICT in Bulgaria   19

Figure 9: Average pupil confidence (scale 1-4) in using ICT skills, by type of skills and pupils' use/access to ICT. Grade 8  21

Figure 10: Time invested by teachers in professional development activities during the past two years, Slovakia compared to EU average, 2011-12, in % of students  25

Figure 11: Use of resources and tools during lessons at grade 11 general education (in % of students, EU level, 2011-12) 31

Figure 12: Availability of content in different languages, in %   35

Figure 13: ICT infrastructure trends (EU average) 41

Figure 14: Distribution of student/computer ratio in schools attended by pupils aged 15, 2009  42

Figure 15: Percentage of individuals aged 16-74 with low, medium and high computer skills. 2011  48

Figure 16: Geographical coverage of recent 1:1 Learning initiatives in Europe   54

Figure 17: Objectives tackled by the 31 recent 1:1 initiatives  54

Figure 18: Scale of innovation of recent 1:1 learning initiatives in Europe   55

Figure 19: The timeline and milestones of eTwinning development  57

Figure 20: eTwinning statistics  58

Figure 21: MOOCS and Open Education Timeline   64

Figure 22: Downes’ comparative diagrams of interaction in traditional and networked online education   66

Figure 23: MOOCs in Europe   67

Figure 24: The MOOC Hype Cycle   68

List of Boxes

Box 1: A few ideas about the future   6

Box 2: Specificities of the school books submarket  40

Box 3: "Today, Bolton – tomorrow, the world"  49

List of Examples

Example 1 - Spain. 15

Example 2 - Greece. 16

Example 3 - Slovenia. 24

Example 4 - Austria. 25

Example 5 - France, Germany. 27

Example 6- Denmark. 30

Example 7 - Cyprus, Finland. 32

Example 8  - Belgium and the Netherlands. 33

Example 9 - Ireland. 39

Example 10 - Slovenia. 40

Example 11 - Finland. 43

Example 12 - Germany, Luxembourg, France, Belgium.. 62

Example 13 - Germany. 62

Example 14 - Norway. 64

Example 15 - United Kingdom.. 64

[1]     Open Educational Resources (OERs) are any type of educational materials that are in the public domain or introduced with an open license. The nature of these open materials means that anyone can legally and freely copy, use, adapt and re-share them. OERs range from textbooks to curricula, syllabi, lecture notes, assignments, tests, projects, audio, video and animation. (UNESCO 2012)

[2]     Cedefop 2010: Skills supply and demand in Europe - Medium-term forecast up to 2020;

      http://www.cedefop.europa.eu/en/Files/3052_en.pdf

[3]     The Future of Education: The 2013 NMC Horizon Project Summit Communiqué. http://www.nmc.org/pdf/2013-Horizon-Project-Summit-Communique.pdf

[4]     Sharples 2012: UK Open University’s Innovating Pedagogy 2012 Report http://www.open.ac.uk/personalpages/mike.sharples/Reports/Innovating_Pedagogy_report_July_2012.pdf

[5]     New Media Consortium 2013: Horizon Report, Higher Education & K-12 http://www.nmc.org/pdf/2013-horizon-report-HE.pdf, The NMC Horizon Report: 2013 K-12 Edition, http://www.nmc.org/pdf/2013-horizon-report-k12.pdf

The New Media Consortium is an international community of educational experts that collaborated with EDUCASE Learning Initiative in early 2013 to publish the annual Horizon Report. The Report describes trends and predicts which ones will be adopted in the short (< 1 year), medium (2-3 years) or long (4-5 years) term.

[6]     IPTS 2011 The Future of Learning: Preparing for Change.  JRC Scientific and Technical Report, EUR 24960 EN.  http://ipts.jrc.ec.europa.eu/publications/pub.cfm?id=4719

[7]     Sharples 2012: UK Open University’s Innovating Pedagogy 2012 Report http://www.open.ac.uk/personalpages/mike.sharples/Reports/Innovating_Pedagogy_report_July_2012.pdf

[8]     IPTS 2013 Mapping and Analysing Prospective Technologies for Learning. Results from a consultation with European stakeholders and roadmaps for policy action. JRC Scientific and Policy Reports, in collaboration with Menon network.

      EUR: JRC81935. http://ipts.jrc.ec.europa.eu/publications/pub.cfm?id=6360.

[9]     Special needs, remote learners, early school leavers, migrant children, adult learners, unemployed, etc.

[10]    Based on IPTS 2011,  p. 43

[11]    IPTS 2011

[12]    European Commission 2008: Staff Working Document on ICT and  Education

[13]    http://www.etwinning.net

[14]    Duval et al. 2011. Towards an Open Learning Infrastructure for Open Educational Resources: Abundance as a Platform for Innovation. In C.S. Calude, G. Rozenberg, A. Salomaa (Eds.): Maurer Festschrift, LNCS 6570, pp. 144–156,

Springer-Verlag Berlin Heidelberg. https://lirias.kuleuven.be/bitstream/123456789/323814/1/rainbow.pdf

[15]    European Commission 2013: Report on the Provision of Digital Resources and ICT in Education in the Member States

[16]    JRC-IPTS http://is.jrc.ec.europa.eu/pages/EAP/eLearning.html

[17]    See Website DG EAC

[18]    http://ec.europa.eu/dgs/education_culture/consult/open_en.htm

[19]    http://ministerialconference2012.linkevent.no/index.htm

[20]    http://ec.europa.eu/dgs/education_culture/consult/open_en.htm

[21]    More in detail, the main types of organisations that responded to the consultation where: Universities (13), Organisations promoting ICT in education (12), Organisations promoting Open Educational Resources (8), NGOs (8), ICT industry (5)

[22]    Research shows systematic and massive uptake of new technologies in education and training has not yet happened:

      European Journal of Education, March 2013, Issue 1 on ICT and Education: Taking stock of progress and looking at the future. http://onlinelibrary.wiley.com/doi/10.1111/ejed.2013.48.issue-1/issuetoc

Eurydice 2011: Key Data on Learning and Innovation through ICT at School in Europe http://eacea.ec.europa.eu/education/eurydice/documents/key_data_series/129en.pdf

Balanskat 2009: Study of the impact of technology in primary schools (STEPS) http://insight.eun.org/ww/en/pub/insight/school_innovation/best_practice/steps.htm

European Schoolnet and University of Liège 2013: Survey of Schools: ICT in Education, Final report based on over 190,000 responses from students, teachers and head teachers in 27 countries collected and analysed during the school year 2011-12. The Survey of Schools: ICT in Education provides detailed, up-to-date and reliable benchmarking ICT in school level education (primary, secondary and initial VET) across Europe. The survey was commissioned in 2011 by the European Commission to benchmark access, use and attitudes to ICT in schools in 31 countries (EU27, Croatia, Iceland, Norway and Turkey) https://ec.europa.eu/digital-agenda/sites/digital-agenda/files/KK-31-13-401-EN-N.pdf.

[23]    OECD 2011: PISA 2009 Results: Students On Line: Digital Technologies and Performance (Volume VI)

http://www.oecd.org/pisa/pisaproducts/pisa2009/48270093.pdf

Kozma 2009: Assessing and teaching 21st century skills: A call to action. In F. Schueremann & J. Bjornsson (eds.), The transition to computer-based assessment: New approaches to skills assessment and implications for large scale assessment (pp. 13-23)

IPTS 2013: ICT-enabled innovation for learning in Europe and Asia - Exploring conditions for sustainability, scalability and impact at system level, by Kampylis, Law & Punie, JRC Scientific and Policy Reports, in collaboration with Centre for Information Technology in Education (CITE), University of Hong Kong: EUR: JRC83503. http://ipts.jrc.ec.europa.eu/publications/pub.cfm?id=6362

[24]    OECD 2011 ; Eurydice 2011; European Schoolnet & University of Liège 2013

[25]    Eurydice 2011, European Schoolnet & University of Liège 2013

[26]    See GHK report on key competences

[27]    Eurydice 2011

[28]    TIMMS 2007, PISA 2009, European Schoolnet & University of Liège 2013

[29]    Eurydice 2011;  PISA 2009

[30]    European Schoolnet & University of Liège 2013

[31]    e-Maturity is the level of integration of ICT in the teaching and learning process. An e-mature school can also be referred to as a digital competent and supportive school.

[32]    European Schoolnet & University of Liège 2013

[33]    European Commission 2013: Report on the Provision of Digital Resources and ICT in Education in the Member States

[34]   Comparison between the 2013 European Schoolnet & University of Liège survey and a similar survey carried out in 2006

[35]    EC DigitalAgenda Scoreboard: http://ec.europa.eu/digital-agenda/en/scoreboard

[36]    European Schoolnet and University of Liège 2013

[37]    European Schoolnet & University of Liège 2013 

[38]    Zickuhr, Rainie & Purcell 2012: Younger American's Library Habits. Pew Research Center's Internet and American Life Project, http://libraries.pewinternet.org/files/2013/06/PIP_Younger_Americans_and_libraries.pdf

[39]    Livingstone et al. 2011: Risks and safety on the internet. The perspective of European children: Full findings and policy implications from the EU Kids Online survey of 9-16 year-olds and their parents in 25 countries, EU Kids Online Network, http://www2.cnrs.fr/sites/en/fichier/rapport_english.pdf

See also on digital games for inclusion and empowerment: IPTS 2013 The Industry and Policy Context for Digital Games for Empowerment and Inclusion: Market Analysis, Future Prospects and Key Challenges in Videogames, Serious Games and Gamification, JRC Scientific and Policy Reports, EUR 25910. http://ftp.jrc.es/EURdoc/JRC77656.pdf

[40]    OECD 2011, p. 19

[41]    IPTS 2012: ICT and Learning - results from PISA 2009, pp. 28–42 by Biagi & Loi, JRC Scientific and Policy Reports, EUR: 25581, http://ftp.jrc.es/EURdoc/JRC76061.pdf

[42]    OECD 2011

[43]    European Schoolnet & University of Liège 2013

[44]    European Schoolnet & University of Liège 2013

[45]    Eurydice 2011

[46]    SWD (2012) 371 Assessment of key competences in initial education and training, http://ec.europa.eu/education/news/rethinking/sw371_en.pdf and COM (2012) 669 Rethinking Education: Investing in skills for better socio-economic outcome, http://ec.europa.eu/education/news/rethinking/com669_en.pdf

[47]    OECD 2011

[48]    OECD & CERI 2010: Are the New Millennium Learners Making the Grade? Technology Use and Educational Performance in PISA 2006, http://www.oecd-ilibrary.org/education/are-the-new-millennium-learners-making-the-grade_9789264076044-en

[49]    EC 2012:  Digital Competences in the Digital Agenda, Digital Agenda Scoreboard 2012,

https://ec.europa.eu/digital-agenda/sites/digital-agenda/files/scoreboard_digital_skills.pdf

[50]    IPTS 2010: Learning in Informal Online Networks and Communities, by Ala Mutka, JRC-IPTS Scientific and Technical Reports, EUR 24149, http://ftp.jrc.es/EURdoc/JRC56310.pdf

[51]    OECD & CERI 2010: Are the New Millennium Learners Making the Grade? Technology Use and Educational Performance in PISA 2006, http://www.oecd-ilibrary.org/education/are-the-new-millennium-learners-making-the-grade_9789264076044-en

[52]    Confederation of Finnish Industries 2013

[53]    European Schoolnet & University of Liège 2013

[54]    European Schoolnet & University of Liège 2013

[55]    European Schoolnet & University of Liège 2013

[56]    Scheerens 2010: Teachers' professional development. Europe in International Comparison. A secondary analysis based on TALIS dataset, OPOCE, Luxembourg

http://ec.europa.eu/education/school-education/doc/talis/report_en.pdf

[57]    Eurydice 2011

C 398/1 Council Recommendation of 20.12.2012 on the validation of non-formal and informal learning,

http://eur-lex.europa.eu/LexUriServ/LexUriServ.do?uri=OJ:C:2012:398:0001:0005:EN:PDF

[58]    For example in Austria's primary schools only 24% of students are taught by teachers who feel confident in using ICT, compared to 51% at EU level.

[59]    European Schoolnet & University of Liège 2013

[60]    European Commission 2013: Report on the Provision of Digital Resources and ICT in Education in the Member States

(Austria)

[61]    European Schoolnet & University of Liège 2013

[62]    Shear Linda, Gorges Torie et al SRI International Research  (2010) The Innovative Schools Program Year 2 Evaluation Report Microsoft partners http://www.itlresearch.com/images/stories/reports/isp_year_2_eval_full_report%20final.pdf

[63]    C 398/1 Council Recommendation of 20.12.2012 on the validation of non-formal and informal learning

http://eur-lex.europa.eu/LexUriServ/LexUriServ.do?uri=OJ:C:2012:398:0001:0005:EN:PDF

[64]    http://grial.usal.es/agora/trailerproject/about

[65]    European Commission 2013: Report on the Provision of Digital Resources and ICT in Education in the Member States (France, Luxembourg)

[66]    European Commission 2013: Report on the Provision of Digital Resources and ICT in Education in the Member States (Germany)

[67]    www.pearsonvue.com

[68]    www.saylor.org

[69]    www.chea.org

[70]    www.acenet.edu

[71]    Casilli, C., Lee, S. and McAvoy, C. 2012: Mozilla Open Badges: into the great wide open. Open Education Conference, https://www.surfspace.nl/artikel/937-blog-open-education-2012-conference-dag-2-17-oktober-2012,in: OER Special Interest Group 2013: Trend Report: Open Educational Resources 2013, http://www.surf.nl/en/publicaties/Documents/Trend%20Report%20OER%202013_EN_DEF%2007032013%20%28LR%29.pdf            

[72]    Camilleri & Tannhäusser 2012: Open Learning Recognition: taking Open Educational Resources a step further. http://cdn.efquel.org/wp-content/uploads/2012/12/Open-Learning-Recognition.pdf?a6409c, in: OER Special Interest Group 2013: Trend Report: Open Educational Resources 2013, http://www.surf.nl/en/publicaties/Documents/Trend%20Report%20OER%202013_EN_DEF%2007032013%20%28LR%29.pdf  

[73]    Gaber 2012: edX announces option of proctored exam testing through

collaboration with Pearson VUE, http://www.pearsonvue.com/about/release/12_09_06_edx.asp in: OER Special Interest Group 2013: Trend Report: Open Educational Resources 2013, http://www.surf.nl/en/publicaties/Documents/Trend%20Report%20OER%202013_EN_DEF%2007032013%20%28LR%29.pdf

[74]    European Commission 2012: Assessment of key competences in the initial education and training, SWD (2012) 371, http://ec.europa.eu/education/news/rethinking/sw371_en.pdf

[75]    Eurydice 2011a: How do countries respond to changing skills demands? Some challenges and policy issues in the implementation of key competences

[76]    IPTS 2013: The use of ICT for the Assessment of Key Competences, JRC Scientific and Policy Reports, EUR 25891. http://ipts.jrc.ec.europa.eu/publications/pub.cfm?id=5719; EC COM Rethinking education, 2012

[77]    http://www.knewton.com/

[78]    IPTS 2013: The Use of ICT for the Assessment of Key Competences, ibid.

[79]    Eurydice 2011a: How do countries respond to changing skills demands? Some challenges and policy issues in the implementation of key competences

[80]    Eurydice 2011: Key Data report on Learning and Innovation through ICT

[81]    European Schoolnet & University of Liège 2013

[82]    McAndrew, Patrick. 2010. Fostering Open Educational Practices in ICT in Teacher Education: Policy, Open Educational Resources and Partnership, Proceedings of International Conference IITE-2010. UNESCO Institute for Information Technologies in Education; Hache, Alexandra. Towards the Sustainability of OER Initiatives.

[83]    European Schoolnet & University of Liège 2013

[84]    Eurydice 2011

[85]    Wikiwijs Program Plan

[86]    OPAL Report. Beyond OER. 2011

[87]   http://www.ocwconsortium.org/en/members/members/master; http://opencourseware.eu

[88]   http://www.opendoar.org/countrylist.php?cContinent=Europe

[89]    OPAL Report. Beyond OER.

[90]    IPTS presentation at Open Education 2030: Foresight workshop on School Education, Seville, 28-29 May 2013, See http://blogs.ec.europa.eu/openeducation2030/b-workshop-on-school-education.

[91]    www.opendiscoveryspace.eu

[92]    European Commission 2013: Report on the Provision of Digital Resources and ICT in Education in the Member States

[93]    e-Learning Development Centre’s repository initiative.

[94]    i.e. Vetamix initiative. http://edrene.org/results/currentState/finland.html

[95]    i.e. Vetamix initiative: http://edrene.org/results/currentState/finland.html

[96]    IPTS presentation at Open Education 2030: Foresight workshop on School Education, Seville, 28-29 May 2013, See http://blogs.ec.europa.eu/openeducation2030/b-workshop-on-school-education.

[97]    E.g. Open Discovery Space (ODS), www.opendiscoveryspace.eu; ; Learning Resource Exchange (LRE) www.lre.eun.org

[98]    McGreal, Athabasca University: Resource Repositories Analysis

http://academia.edu/2832823/Open_educational_resource_repositories_An_analysis

[99]    http://lreforschools.eun.org/web/guest/home

[100] This is confirmed by an international survey on the use of OER in Higher Education and Adult learning (OPAL 2011)

[101] Quality assurance models are supported by 83.6% of the organisations and 73.2% of individuals who responded to the public consultation

[102] Bacsich 2012: The cost- and time-effectiveness of online learning: providing a perspective on Microlearning and the differences between academic & corporate views, http://www.scribd.com/doc/96397285/Time-Bacsich-Final-Final-PDF

[103] Jim Ayre & David Massart,  LearningResource Exchange Network:

[104] Hyle et al. 2012: Open Education resources: analysis of responses to the OECD country questionnaire, OECD Education Working Papers, No.76, OECD Publishing.

[105] Casa das Ciências initiative.

[106] PrimTICE and Edu’Bases. http://eduscol.education.fr/bd/urtic/ses/

[107] Académies’ corresponds to regional education authorities in France.

[108] e-Learning Development Centre’s repository

[109] EDU.fi portal initiative

[110]            ASK-LOMAP v1.0 is an open source web-based application for creating application profiles and manipulating application profile registry.

[111] POERUP is a project approved by the Lifelong Learning Programme under Key Activity 3 ICT (http://poerup.referata.com/wiki/Countries_with_OER_initiatives). The project Consortium is a group of organisations across Europe and Canada interested in understanding how to foster the uptake of OER by governments (national and regional) and groups of educational institutions. It covers all sectors of education with a core focus on higher education and schools. For the summary see http://www.poerup.info

[112] Pawlowski & Clements 2011: User-oriented quality for OER: understanding teachers' views on re-use, quality, and trust.

[113] Schuwer and Janssen, 2013, Trends in Business Models for Open Educational Resources and Open Education

[114] OCWC 2012

[115] Howard 2012

[116] OCWC 2012

[117] Young 2012

[118]  European Learning Industry Group, 2011

[119]  European Commission 2013: Report on the Provision of Digital Resources and ICT in Education in the Member States

[120]  Savoir Livre et Syndicat National de l'Edition, 2010

[121]  Skidelski, 2011; Levine, 2011; Koch, 2006

[122]  Séré et al. 2010: Le manuel scolaire a l'heure du numérique: les premiers usages. Une enquête.

[123]  European Commission 2013: Report on the Provision of Digital Resources and ICT in Education in the Member States

[124] Digital Agenda Assembly Workshop 1 report on 18/6/2013 in Dublin; http://www.bbc.co.uk/news/education-20930195; http://www.independent.co.uk/news/education/education-news/the-school-where-every-teacher-has-an-ipad-and-every-student-has-an-ipod-7578167.html

[125]  European Schoolnet and University of Liège 2013

[126] Eurydice 2011; OECD 2011

[127] Eurydice, based on OECD, PISA 2009 database

[128] European Schoolnet & University of Liège 2013

[129] http://yle.fi/uutiset/educational_data_cloud_service_planned_for_finland/6714130

[130] Bacsich 2012a

[131]  Supporting Interoperable Learning Technology. Saltis 2009. http://www.saltis.org/papers/silt.pdf; Kurilovas E. Intelligent Distributed Computing III. Studies in Computational Intelligence. Volume 237, 2009, pp 121-130 Interoperability, Standards and Metadata for E-Learning; The Future of Interoperability Standards in Education: System and Process by Li Yuan, Scott Wilson, Adam Cooper & Lorna M Campbell http://wiki.cetis.ac.uk/images/3/38/Fis_whitepaper_final_.pdf;

[132] "Digital textbooks open a new chapter" 18 October 2011. http://www.bbc.co.uk/news/business-15175962

[133] http://etextbookseurope.eu/

[134] For further references, see European Commission 2013: Report on the Provision of Digital Resources and ICT in Education in the Member States (Finland)

[135] EC 2007: COM(2007) 496 of 7.9.2007 E-skills for the 21st century: Fostering competitiveness, growth and jobs, http://ec.europa.eu/enterprise/sectors/ict/files/comm_pdf_com_2007_0496_f_en_acte_en.pdf

[136] See also IPTS 2013 Literature Review on Employability, Inclusion and ICT, Report 2: ICT and Employability, JRC Technical Reports, EUR 25792. http://ftp.jrc.es/EURdoc/JRC78601.pdf

[137] The underlying reasons for such skills gap are complex and not due to a simple lack of digital skills, but general digital competence is a precondition for a professional career in ICT and hence deserves to be developed through digitally – based learning.

[138] Recommendation 2006/962/EC of the European Parliament and of the Council of 18 December 2006 on key competences for lifelong learning,

      http://europa.eu/legislation_summaries/education_training_youth/lifelong_learning/c11090_en.htm

[139] JRC-IPTS 2013: DIGCOMP: A framework for developing and understanding Digital Competence in Europe. JRC Scientific and Policy Reports. See EUR JRC83167. http://ipts.jrc.ec.europa.eu/publications/pub.cfm?id=6359.

[140] Computer skills are defined as having ever performed at least one of the following activities: Copying or moving a file or folder; using coping and paste tools to duplicate or move information within a document; using basic arithmetic formulas in a spread sheet; compressing (or zipping files); connecting and installing new devices; writing a computer programme using a specialized programming language. Low computer skills refers to having done one or two of these computer-related activities, medium skills refers to having done three or four of these activities, and high skills five or all of them. Data on digital skills (computer skills) are available for 2012 on the Eurostat website and analysed in this year's Digital Agenda Scoreboard. The questions on confidence have not been updated as they formed part of a special module in 2011. However, it should be noted that these indicators are under review and in general should be interpreted with some caution since surveys face limitations in skills assessment.

[141] Eurostat, Information Society Statistics (data extraction: June 2012). For details about different types of computer activities, see http://epp.eurostat.ec.europa.eu/cache/ITY_PUBLIC/4-26032012-AP/EN/4-26032012-AP-EN.PDF. Data on digital skills confidence also from Eurostat.

[142] Luckin et al., 2012: Decoding learning - The proof promise and potential of digital education. NESTA http://www.nesta.org.uk/library/documents/DecodingLearningReport_v12.pdf

[143] Ecotec, 2007: Final Evaluation of the eLearning Programme: Annex to the Joint Report http://ec.europa.eu/dgs/education_culture/evalreports/training/2007/joint/elearning_en.pdf  

Public Policy and Management Institute, 2011: Interim Evaluation of the Lifelong Learning Programme 2007-2013 http://ec.europa.eu/dgs/education_culture/evalreports/education/2011/llpreport_en.pdf

[144] OECD Education at a Glance 2013. http://www.oecd.org/edu/eag.htm, http://www.oecd.org/newsroom/value-of-education-rises-in-crisis-says-oecd.htm

[145] SRI International Center for Productivity in Learning 2012: Understanding the Implications of Online Learning for Educational Productivity. US Department of Education, Office of Educational Technology. 

http://www.sri.com/sites/default/files/publications/implications-online-learning.pdf

Butler Battaglino et al. 2012: The Costs of Online Learning. In: Creating Sound Policy for Digital Learning. A Working Paper Series from the Thomas B. Fordham Institute. http://gsehd.gwu.edu/documents/users/juliestella/The-costs-of-online-learning.pdf

President Obama Speaks on Technology in Schools. June 6, 2013. http://www.whitehouse.gov/photos-and-video/video/2013/06/06/president-obama-speaks-technology-schools#transcript

http://yle.fi/uutiset/educational_data_cloud_service_planned_for_finland/6714130

[146] http://www.essaacademy.org/, Digital Agenda Assembly Workshop 1 report on 18/6/2013, Dublin, http://www.bbc.co.uk/news/education-20930195, http://www.independent.co.uk/news/education/education-news/the-school-where-every-teacher-has-an-ipad-and-every-student-has-an-ipod-7578167.html

[147] Original figures in GBP, exchange rates 1€=0.8492£ as of 3/July/2013, https://www.ecb.int/stats/exchange/

[148] Various Authors 2011: ¿Qué opina el profesorado sobre el Programa Escuela 2.0? Un análisis por comunidades autónomas? Preliminary report of the research project EDU2010-17037 funded by the Spanish Ministry of Science and Innovation, http://ntic.educacion.es/w3//3congresoe20/Informe_Escuela20-Prof2011.pdf

[149] Original figures in USD, rounded exchange rate 1€=1.2959$ as of 3/July/2013, https://www.ecb.int/stats/exchange/

[150] Marcus 2006: US rage at textbook price hike. In: Times Higher Education, 11th of August 2006

[151] Original figures in USD, rounded exchange rate 1€=1.2959$ as of 3/July/2013, https://www.ecb.int/stats/exchange/

[152] Athabasca University et al. 2011: Open Education Resource University. Towards a logic model and plan for action.

      http://wikieducator.org/images/c/c2/Report_OERU-Final-version.pdf

[153] Lewin 2012: College of Future Could Be Come One, Come All. In: The New York Times, 19th of November 2012

[154] http://www.open.ac.uk/platform/news-and-features/study-open-education-mooc; http://www.timeshighereducation.co.uk/422137.article

[155] http://opencourseworld.de/

[156] http://moocs.epfl.ch/eu-mooc-summit

[157] Foray & Raffo 2012: Business-Driven Innovation: Is It Making a Difference in Education? – An Analysis of Patents. OECD Education Working Papers, No. 84

Ambient Insight 2012: Snapshot of the Worldwide and US Academic Digital Learning Market.

http://www.ambientinsight.com/Resources/Documents/AmbientInsight-2012-Snapshot-Worldwide-US-Academic-DigitalLearningMarket.pdf

[158] A snapshot of the Learning Industry in Europe in 2011. European Learning Industry Group ELIG. A summary for 2011. Produced by the ELIG Secretariat

[159] The section is largely based on the following IPTS reports: IPTS 2013 ICT-enabled innovation for learning in Europe and Asia. Exploring conditions for sustainability, scalability and impact at system level. JRC Scientific and Policy Reports, in collaboration with Centre for Information Technology in Education (CITE), University of Hong Kong. (EUR: JRC83503, http://ipts.jrc.ec.europa.eu/publications/pub.cfm?id=6362); IPTS 2013 Overview and Analysis of 1:1 Learning Initiatives in Europe. JRC Scientific and Policy Reports, in collaboration with European Schoolnet, EUR: JRC81903. http://ipts.jrc.ec.europa.eu/publications/pub.cfm?id=6199

[160]  Foundation 2008

[161] Balanskat & Garoia 2010

[162] IPTS 2013 Overview and Analysis of 1:1 Learning Initiatives in Europe. JRC Scientific and Policy Reports, in collaboration with European Schoolnet, EUR: JRC81903. http://ipts.jrc.ec.europa.eu/publications/pub.cfm?id=6199

[163] IPTS 2013 ICT-enabled innovation for learning in Europe and Asia. Exploring conditions for sustainability, scalability and impact at system level. JRC Scientific and Policy Reports, in collaboration with Centre for Information Technology in Education (CITE), University of Hong Kong.; EUR: JRC83503, http://ipts.jrc.ec.europa.eu/publications/pub.cfm?id=6362

[164] Country codes (cfr. EC, Eurydice, 2012): AT-Austria, CY-Cyprus, CZ-Czech Republic, DK-Denmark, EE-Estonia, FR-France, GE-Georgia, DE-Germany, EL-Greece, IL-Ireland, IT-Italy, LT-Lithuania, NO-Norway, PT-Portugal, SK-Slovakia, ES-Spain, SE-Sweden, TR-Turkey, UK-The United Kingdom, EU-Europe (ACER-EUN initiative).

[165] This section is largely based on IPTS 2013 ICT-enabled innovation for learning in Europe and Asia. Exploring conditions for sustainability, scalability and impact at system level. JRC Scientific and Policy Reports, in collaboration with Centre for Information Technology in Education (CITE), University of Hong Kong. EUR: JRC83503, http://ipts.jrc.ec.europa.eu/publications/pub.cfm?id=6362

[166] See also Vuorikari, R. et al. 2012 Teacher networks - Today’s and tomorrow’s challenges and opportunities for the teaching profession. Brussels: European Schoolnet. Retrieved 5 April 2013, from http://bit.ly/1753nIv; IPTS 2011 Teacher Collaboration Networks in 2025. What is the role of teacher Networks for professional development in Europe? JRC Technical Note JRC67530.  http://ipts.jrc.ec.europa.eu/publications/pub.cfm?id=4739; Vuorikari, R. 2010. Teachers' professional development - An overview of current practice. Brussels: Central Support Service for eTwinning & European Schoolnet. Retrieved 5 April 2013, from http://tinyurl.com/d7lz596

[167] Since March 2013, selected schools from five Eastern Partnership countries (Azerbaijan, Armenia, Georgia, Moldova, Ukraine) and Tunisia are also involved through eTwinning Plus (http://plus.etwinning.net).

[168] http://ec.europa.eu/education/comenius/school_en.htm

[169] The current list of eTwinning groups can be found at http://www.etwinning.net/en/pub/progress/groups.htm

[170] These informal Rooms are available only to registered users who can either join or create a Room for discussing any topic of interest with their colleagues for a limited amount of time (up to 3 months).

[171] Workshops organized by the CSS and/or NSSs that are take place in different European cities throughout the school year aiming at teachers who want to improve their professional skills and competences.

[172] Short online events on a number of themes that are run by education experts offering an introduction to a topic and helping participants to develop their skills and knowledge. See also Holmes & Sime, 2012.

[173] European Commission 2013

[174] http://www.consilium.europa.eu/ueDocs/cms_Data/docs/pressData/en/ec/71025.pdf

[175] The eTwinning Central Support Service (CSS) portal (http://www.etwinning.net) is run and managed by European Schoolnet on behalf of the European Commission’s Directorate General for Education and Culture and it is available in twenty-five European languages. eTwinning Plus portal is at http://plus.etwinning.net. The websites of the 35 NSSs can be found at http://www.etwinning.net/en/pub/get_support/contact.htm

[176] http://internetaula.ning.com/

[177] http://schoolsonline.britishcouncil.org/projects-and-resources/commonwealth-class

[178] http://www.tes.co.uk/article.aspx?storyCode=6000208&navCode=285

[179] IPTS 2013: ICT-enabled innovation for learning in Europe and Asia - Exploring conditions for sustainability, scalability and impact at system level, by Kampylis, Law & Punie, JRC Scientific and Policy Reports, in collaboration with Centre for Information Technology in Education (CITE), University of Hong Kong. EUR: JRC83503, http://ipts.jrc.ec.europa.eu/publications/pub.cfm?id=6362

[180]            European Commission, 2011

[181] The figures refer only to eTwinning -as there are not yet statistics from eTwinning Plus- and are constantly increasing. You can see the current number of registered users, schools and projects at the eTwinning CSS (Central Support Service) portal: http://tinyurl.com/crwonh8. See also the interactive map of eTwinning coverage and statistics by country at http://tinyurl.com/c8ddff3.

[182] A comparison of the figures of 15 April 2013 with the ones of 24 July 2012 (European Commission, 2013, p. 34) reveals that in a period of approximately 9 months 29,975 new users (+14.97%) and 11,652 schools (+11.14%) have registered in eTwinning platform. Accordingly, the number of projects has grown steadily. See more about recent statistics of eTwinning at http://bit.ly/10Vx2nt

[183] Some countries have passed the 2.5% milestone of “innovators” (e.g., Estonia, Iceland, Slovakia, the Czech Republic, Slovenia and Finland) and are currently targeting the segment of “early adopters” within their teacher population (Vuorikari et al., 2011).

[184] eTwinning reach = the registered users / teacher population

[185] See also http://www.etwinning.net/en/pub/news/news/etwinning_school_teams_divide.htm

[186] http://eur-lex.europa.eu/LexUriServ/LexUriServ.do?uri=OJ:C:2011:372:0001:0006:EN:PDF

[187] http://www.ocwconsortium.org

[188] http://www.ocwconsortium.org/en/courses/search as of 3/July/2013

[189]   Yuan and Powell 2013

[190] http://www.regjeringen.no/nb/dep/kd/pressesenter/pressemeldinger/2013/utvalg-om-hoyere-utdanningstilbud-pa-net.html?id=731443

[191] go.nature.com/mjuzhu

[192] Steven Downes in discussion on G+ Sept 19, 2012, http://bit.ly/14mzWQx and slide 6 in slideshare from Potsdam talk Oct 8, 2012 at http://slidesha.re/SJ43zx

[193]  Trend Report SURF 2013

[194]  Lewin 2012

[195] See for instance: Attwood, R. (2011). California is an example of State promoting OER in public colleges, partly due to its financial crisis,  http://leginfo.legislature.ca.gov/faces/billNavClient.xhtml?bill_id=201120120SB1053

[196] http://www.eua.be/news/13-02-25/Massive_Open_Online_Courses_MOOCs_EUA_to_look_at_development_of_MOOCs_and_trends_in_innovative_learning.aspx

[197] P.A.U. Education 2013

[198] Gartner 2012, the information technology research firm, has applied its Hype Cycle graphic to myriad emerging technologies since 1995, using it as a “representation of the maturity and adoption of technologies - http://www.gartner.com/technology/research/methodologies/hype-cycle.jsp

[199] Li Yuan & S. Powell 2013

[200] Hill 2012: Educause Review Online

[201] Les Schmidt 2012, http://www.moocologist.com/wp-content/uploads/2013/02/MOOC_HypeCycle_12111.png

[202] www.openuped.eu, www.eadtu.eu

[203] P.a.u. education 2013: Hosting, management, promotion and maintenance of the European Commission's internet portal on eLearning and prepare its translation to an Open Education Portal

[204] This section is largely based on input from the following IPTS reports: IPTS 2013 ICT-enabled innovation for learning in Europe and Asia. Exploring conditions for sustainability, scalability and impact at system level. JRC Scientific and Policy Reports, in collaboration with Centre for Information Technology in Education (CITE), University of Hong Kong. EUR; JRC83503, http://ipts.jrc.ec.europa.eu/publications/pub.cfm?id=6362; IPTS 2013 Mainstreaming ICT-enabled innovation in Education and Training in Europe. Policy actions for sustainability, scalability and impact at system level. JRC Scientific and Policy Reports. EUR; JRC83502, http://ipts.jrc.ec.europa.eu/publications/pub.cfm?id=6361

[205] Law, Yuen & Fox 2011: Educational Innovations Beyond Technology: nurturing leadership and establishing learning organizations. New York: Springer

[206] Clarke & Dede, 2009: Design for Scalability: A Case Study of the River City Curriculum. Journal of Science Education and Technology, 18(4), 353–365.

[207] Connectedness refers to the social and emotional factors that profoundly affect the relationships among members of a learning institution and that have a significant impact on their level of engagement and motivation. See IPTS 2012 Innovating Learning: Key Elements for Developing Creative Classrooms in Europe, JRC Scientific and Policy Reports, EUR 25446. http://ftp.jrc.es/EURdoc/JRC72278.pdf   

[208]   IPTS 2013: ICT-enabled innovation for learning in Europe and Asia - Exploring conditions for sustainability, scalability and impact at system level, by Kampylis, Law & Punie, JRC Scientific and Policy Reports, in collaboration with Centre for Information Technology in Education (CITE), University of Hong Kong, EUR: JRC83503, http://ipts.jrc.ec.europa.eu/publications/pub.cfm?id=6362

Top