Highlights from the RDM Programme Progress Report: May to July 2016

The following key results were highlighted in the RDM Programme Progress Report:

  • There were 42 new users and 69 data management plans created with DMPOnline.
  • An additional 1.5PB has been procured for DataStore’s general capacity expansions.
  • The Roslin Institute has deposited 16 datasets into Data Vault.
  • DataShare upload release (2.1) went live on 23 May 2016.
  • There are now 334 dataset records in PURE, an increase of 124 records from the last reporting period (February to April 2016).
  • 54 datasets have been deposited into DataShare.
  • The University of Edinburgh was recommended as a preferred supplier on the Framework for the Research Data Management Shared Services for Jisc Services Ltd (JSL) for the following Lots:
  • Lot 2: Repository Interfaces
  • Lot 3: Data Exchange Interface
  • Lot 6: Research Data Preservation Tools Development
  • Lot 8: User Experience Enhancements
  • A total of 390 staff and postgraduates attended RDM courses and workshops during this quarter.
  • A total of 3,649 learners enrolled for the 5-week RDMS MOOC rolling course from March through July, 2016 and a total of 461 people completed the course in the same time frame.
  • There were 5,198 MANTRA sessions recorded from May to July with 58 to 60 percent identified as new users.
  • Set up an RDM Forum in collaboration with College of Arts, Humanities and Social Sciences (CAHSS) Research Officer and Research Outputs Co-ordinator. The first RDM forum is scheduled for Wednesday, 7 September 2016.

Data Management Planning highlights

We currently hold sample data management plans for grant applications submitted to the Arts and Humanities Research Council (AHRC) the Economic and Social Research Council (ESRC) and the Medical Research Council (MRC).

 Active Data Infrastructure highlights

DataStore

An additional 1.5PB has been procured for general capacity expansions. This capacity will primarily be deployed to the College of Medicine & Veterinary Medicine (CMVM) and the College of Science & Engineering (CSE).

MRC Institute of Genetics & Molecular Medicine (IGMM) has purchased an additional 1.2PB of capacity, and this is now deployed in their dedicated file system.

Data Stewardship highlights

DataShare

The large data sharing investigation was completed for DataShare and reported previously. Upload release (2.1) went live on 23 May 2016. Download release planned following ‘embargo release’ and ShareGeo spatial data migration.

Data Vault

There was a soft release of Data Vault in February 2016, with the Roslin Institute depositing 16 datasets during this quarter.

PURE

There are now 334 dataset records in PURE, an increase of 124 records from the last reporting period (February to April 2016).

Research Data Discovery Service (RDDS)

Two PhD interns are working on School engagement activities (dataset records into PURE / datasets into DataShare) for Divinity & Division of Infection and Pathway Medicine; contracts end 16 September 2016. One PhD intern retrospectively added DataShare metadata to PURE for data deposits prior to PURE Data Catalogue functionality; contract to end 16 September 2016. A fourth PhD intern (to work with School of Informatics) is awaiting for approval.

Data Management Support highlights

A total of 390 staff and postgraduates attended RDM courses and workshops during this quarter.

Other related research data management support activities to highlight

  • A talk was given ‘Understanding and overcoming challenges to sharing personal and sensitive data’ at the ReCon (Research Communication and Data Visualisation) Conference, 24th June 2016, The Edinburgh Centre for Carbon Innovation (ECCI).
  • ‘Working with sensitive data in research’ guide was written for research staff and students in social sciences.
  • Another guide is being written on ‘Sharing and retaining data’ for research staff and students in social sciences.
  • Set up an RDM Forum in collaboration with College of Arts, Humanities and Social Sciences (CAHSS) Research Officer and Research Outputs Co-ordinator. The first RDM forum is scheduled for Wednesday, 7 September 2016.

Other activities to highlight

The outcome of Jisc RDM Shared Services bid that was submitted in March 2016

The Procurement Panel has recommended University of Edinburgh as a preferred supplier on the Framework for the Research Data Management Shared Services for Jisc Services Ltd (JSL) for the following Lots:

  • Lot 2: Repository Interfaces
  • Lot 3: Data Exchange Interface
  • Lot 6: Research Data Preservation Tools Development
  • Lot 8: User Experience Enhancements

Unfortunately, the Procurement Panel has decided not to recommend University of Edinburgh for the following Lots:

  • Lot 1: Research Data Repository
  • Lot 4: Research Information and Administration Systems Integrations

National and International Engagement Activities

From May to June

Stuart Macdonald and Rocio von Jungenfeld ran three workshops for the IS Innovation Fund project, Data-X: Pioneering Research Data Exhibition, with PhD students from across the University. Introduction to Data-X: Pioneering Research Data Exhibition

In June

Stuart Macdonald presented peer-reviewed presentation to IASSIST conference, Bergen: Supporting the development of a national Research Data Discovery Service – a Pilot Project

Robin Rice presented a poster at Open Repositories 2016, Dublin: Data Curation Lifecycle Management at the University of Edinburgh

Pauline Ward presented a lightning talk at Open Repositories 2016, Dublin:  Growing Open Data: Making the sharing of XXL-sized research data files online a reality, using Edinburgh DataShare

Stuart Macdonald was an invited speaker at NFAIS (National Federation of Abstracting and Information Services) Fostering Open Science Virtual Seminar: NFAIS Fostering Open Science Virtual Seminar

In July

Robin Rice gave two presentations (invited and peer-reviewed) at LIBER 2016, Helsinki: University of Edinburgh RDM Training: MANTRA & beyond; Designing and delivering an international MOOC on Research Data Management and Sharing

Robin Rice filled in for Stuart Lewis as invited speaker for JISC-CNI 2016, London: Managing active research in the University of Edinburgh

This is the last quarterly report as the Research Data Management (RDM) Roadmap Project (August 2012 to July 2016) came to a close on 31 July 2016.

There will be discussions with the RDM Steering Group to decide how future reporting will be conducted. These reports will be released on the Research Data Blog as well.

Tony Mathys
Research Data Management Service Co-ordinator

 

Share

Highlights from the RDM Programme Progress Report: February to April 2016

The membership of the Research Data Service Virtual Team across four divisions of IS was confirmed and met for the first time (to replace the former action group meetings) on 11 February where it was agreed meetings would be held approximately every six weeks for information and decision-making.

In February, the DataShare metadata was mapped to the PURE metadata and staff in L&UC and Data Library trained each other for creating dataset records in Pure and reviewing submissions in DataShare. It was agreed that staff would create records in Pure for items deposited in DataShare until the company (Elsevier) provides a mechanism for automatically inputting records into Pure.

In March, Jisc announced that the University of Edinburgh was selected as a framework supplier for their new Research Data Management Shared Service.

A review of the existing ethics processes in each college is in progress with Jacqueline McMahon at the College of Arts, Humanities and Social Sciences (CAHSS) to create a University-wide ethics template. There is also engagement with the School ethics committees at the School of Health in Social Sciences (HiSS), Moray House School of Education (MHSE), Law and School of Social and Political Science (SPS) in CAHSS.

The Research Data Management and Sharing (RDMS) Coursera MOOC opened for enrolment on 1 March 2016. This was completed in partnership with the University of North Carolina-Chapel Hill CRADLE project. Research Data Management and Sharing (RDMS) MOOC stats from the Coursera Dashboard reveal that as of 23 May 2016, there have been 5,429 visitors and 1,526 active learners; 335 visitors have completed the course.

The large data sharing investigation was completed for DataShare and reported previously. (Two new releases in DataShare defined: upload and download). Upload release (2.1) to go live 23 May 2016.

PURE dataset functionality is now included in standard PURE and Research Data Management (RDM) training. There are now 210 dataset records in PURE.

Four PhD interns were hired in mid-March to act as College representatives for the IS Innovation Fund Pioneering Research Data Exhibition. They will be employed until mid-December 2016.

A total of 363 staff and postgraduates attended RDM courses and workshops during this quarter.

There were 30 new DMPonline users and 55 new plans created during this quarter.

There are now 210 dataset metadata records in PURE.

A total of 56 datasets were deposited in DataShare during this quarter.

The total number of DataStore users rose from 12,948 in the previous quarter to 13,239 in this quarter, an increase of 291 new users.

National and International Engagement Activities

In February

  • Stuart Lewis gave a DataVault presentation at the International Digital Curation Conference (IDCC) in Amsterdam.

In March

  • A University news item was released to mark the launch of the Research Data Management and Sharing (RDMS) MOOC on Coursera. http://www.ed.ac.uk/news/2016/dataskills-010316
  • Stuart MacDonald gave an RDM presentation to trainee physicians at the Royal College of Physicians Edinburgh Course: Critical appraisal and research for trainees, Edinburgh. http://www.slideshare.net/smacdon2/rdm-for-trainee-physicians
  • Three delegates from Göttingen University were hosted here. The delegates have shared interests in RDM and visited to gain more insight into RDM support and experiences here.
  • Robin Rice gave an invited talk about the RDMS MOOC and web-based Survey Documentation and Analysis (SDA) tool to Learning, Teaching and Web and elearning@Ed Showcase and Network monthly gathering.

In April

As part of my responsibilities to cover the one year interim of Kerry Miller’s maternity leave, I will be writing blogs for this page until Kerry returns next summer.

Prior to this post, I worked the past 12 years as the geospatial metadata co-ordinator at EDINA. My primary role was to promote and support research data management and sharing amongst UK researchers and students using spatial data and geographical information.

Tony Mathys
Research Data Management Service Co-ordinator


Share

MOOCs in Cultural Heritage Education

This afternoon I will be liveblogging the MOOCs in Cultural Heritage Education event, being held at the Scottish National Gallery of Modern Art in Edinburgh.

As this is a liveblog please excuse any typos and do let me know if you spot any errors or if there are links or additional information that should be included. 

Our programme for today is:

Welcome and Intro – Christopher Ganley (ARTIST ROOMS, National Galleries of Scotland and Tate)

Image of Christopher Ganley (National Galleries of Scotland) Christopher is the learning and digital manager for the National Galleries of Scotland and Tate. In case people here don’t know about Artist Rooms, this is a collection that came to Tate and NGS in 2008. Around 1100 items of art from Anthony d’Offay with the National Heritage Memorial Fund, the Art Fund, the British and Scottish Governments. The remit was to be shared across the UK to engage new audiences, particularly young people. The collection has grown to around 1500 items now – Louise Bourgeois is one of the latest additions. The Artist Rooms Research Partnership is a collaboration between the universities of Glasgow, Edinburgh and Newcastle with Tate and NGS led by the University of Edinburgh. And today’s event is funded by the Royal Society of Edinburgh and has been arranged by the University of Edinburgh School of Education as part of the outreach strand of their research.

Year of the MOOC?: what do Massive Open Online Courses have to offer the cultural heritage sector? – Sian Bayne, Jen Ross (University of Edinburgh)

Sian is beginning. Jen and I are going to situate the programme today. Jen and I are part of the School of Education working in Digital Education, and we are ourselves MOOC survivors!

Image of Sian Bayne (University of Edinburgh)We are going to talk about MOOCs in a higher education context, and our research there, and then talk about what that might mean for museums and the cultural heritage context. Jen will talk about the eLearning and Digital Culture MOOC and expand that out into discussing cultural heritage context.

So, what do we know about MOOCs? It’s a bit of a primer here:

  • Massive: numbers. Largest we ran at Edinburgh had 100k students enrolled
  • Open: no “entrance” requirements.
  • Online: completely.
  • Course: structured, cohort-based. And we don’t talk about that so much but they have a pedagogy, they have a structure, and that distinguishes them from other open education tools.

In terms of where MOOCs are run we have EdX – they have no cultural heritage partners yet. We have Coursera and they do have cultural heritage partners including MOMA. And FutureLearn who have cultural heritage partners yet (but not who are running courses yet).

The upsides of MOOCs is that they have massive reach, a really open field, high profile, massive energy, new partnerships. But on the downsides there are high risks, there are unproven teaching methods – and the pedagogy is still developing for this 1 teacher, 20k students kind of model, and there is a bit of  a MOOC “backlash” as the offer begins to settle into mainstream after a lot of hype.

In terms of cultural heritage there isn;t a lot out there, and only on Coursera. American Museum of Natural History, MOMA, California Institute of the Arts and the new Artist Rooms MOOCs are there. Some interesting courses but it’s still early days, not many cultural heritage MOOCs out there.

So in terms of the UK Jen and I have just completed some research for the HEA on MOOC adoption. One aspect was which disciplines are represented in UK MOOCs. We are seeing a number of humanities and education MOOCs. FutureLearn have the most of these, then Coursera and then there are cMOOCs in various locations. In terms of the University of Edinburgh we launched our first MOOCs – 6 of them across 3 colleges – last January and were the first UK university to do so. This year we have 7 more in development, we have 600k enrollments across all of our MOOCs and sign ups for the Warhol MOOC is well past 10k already.

So why did we get involved? Well we have a strong and growing culture of digital education,. It was an obvious for us to take that step. There was a good strategic fit for our university and we felt it was something we should be doing, engaging in this exciting new pedagogical space. Certainly money wasn’t the motivator here.

MOOCs have been around for a while, and there is still some things to learn in terms of who takes them, who finishes them etc. And we’ve done some research on our courses. Here the Philosophy MOOC saw over 98k students but even our smallest MOOC – equine nutrition- saw a comparable number of registrations to our total on campus student body (of approx 30k). Of the 309k who enrolled about 29% of initially active learners “completed” with a range of 7 – 59% across the six courses. We think that’s pretty good considering that only about a third of those who signed up actually accessed the course – of course it’s easy to sign up for these and hard to find time to do them so we aren’t worried about that. The range of completion is interesting though. We had 200 countries represented in the MOOC sign ups. And age wise the demographic was dominated by 25-39 year olds. And we found most people who took the MOOCs, at least in the first round, mostly had a postgraduate degree already. They were the people interested in taking the MOOCs. And now over to Jen…

Image of Jen Ross (University of Edinburgh)Jen. I want to tell you about the experience that lecturers and tutors had on the eLearning and Digital Cultures MOOC that took place last January. Firstly I wanted to talk about the xMOOC and the cMOOC. the xMOOC is the highly structured, quite linear, institutional MOOCs – the Coursera or FutureLearn model. Some peer interaction, but as a side benefit of the content as the main thing. Teacher presence in these sorts of MOOCs tends to be very high profile – the rock star tutor concept. You won’t meet them but you’ll see them on video. A lot. The other sort is the cMOOC, the connected MOOC. these were thought of by Canadians in 2012/13 before MOOCs became built. Around the theory of connected environments, participants create the course together, very loosely structured, very collaborative, very focused on participant contributions. Not about the rock star professors. This difference has been quite a big press thing, xMOOCs have had a bashing, people suggesting they are “elearning from 1998 minus the login button”. But actually what Sian and I have been finding is that in ANY MOOC we see much more than these two different forms. Our own MOOC is really neither an xMOOC or a cMOOC but had a lot of other content.

So our MOOC, #EDCMOOC, was based upon a module of the MSc in Digital Education module that generally has about 12-16 participants, and instead trying these ideas about the self in online environment in a MOOC format, at huge scale. So we decided rather than doing week by week lecture heavy format, we would do something different. Instead we did a “film festival” – clips for participants to watch and talk about. Then some readings on theory of digital education. And questions to discuss. We asked students to create public facing blogs which we linked to, we also used the built in discussion spaces. And instead of weekly tests etc. we had a single peer assessed “digital artefact” final assignment.

We gathered all blogs, which they had registered with us, in one place – so you could see any post tagged with #EDCMOOC. And we had a live hangout (via Google+ / YouTube) at the end of every few weeks – and we would pick up on discussions, questions that were coming up in those discussions and coming in live. The students themselves (42k of them) created a Facebook Group, a G+ group, used the hashtag but also these additional groups meant there was so much material being produced, so much discussion and activity beyond a scale anyone could keep up with. A hugely hectic space for five weeks, with everyone trying as best they could to keep an eye on their corner of the web.

Bonnie Stewart described our MOOC as “subverting it’s own conditions of existence”. And it was a chance to rethink that xMOOC/cMOOC divide. But also what the teacher is in a MOOC. What it means pedagogically to be in a MOOC. There are interesting generative questions that have come out of this experience.

So, I want to show you some examples of materials participants made on the MOOC. Students shared these on Padlet walls. We also had an image competition halfway through the MOOC. e.g. “All Lines are Open” by Mullu Lumbreras – the Tokyo underground map re-imagined with many “You are here” markers – emphasizing the noisiness of the MOOC! There were many reflective and reflexive posts about students trying to get to grips with the MOOC itself, as well as the content. There was such a variety of artefacts submitted here! There were images, videos, all sorts of assignments including super critical artefacts, such as Chris Jobling’s “In a MOOC no-one hears you leave” – although interestingly we did. There was also a chatbot assignment – allowing you to talk to “an EDCMOOC participant” and used comments from chats and from the course to give back comments, really interesting comment on the nature of the MOOC and the online environment. We also had a science fiction story all created in Second Life. This must have taken such a lot of time. We have found this on the MSc in Digital Education as well that when you give people the opportunity to create non textual assignments and contributions they give such creative and take such a lot of time over their multimodal work.

We also had  – a nod for Artist Rooms colleagues – a Ruschagram tool as an assignment. And indeed people used their own experience or expertise to bring their own take to the MOOC. Artists created art, scientists drew on their own background. Amy Burbel – an artist who does lots of these online videos but this one was all about the EDCMOOC.

Image of Jen Ross and Sian BayneSo I’d like to finish with some ideas and questions here for discussion… Elizabeth Merritt from the Centre for the Future of Museums asks about MOOCs in terms of impact. Rolin Moe talks about MOOCs as public engagement on a different scale. Erin Branham asks about reach – why wouldn’t you run a MOOC even if only 20k people finish. We have comments on that actually… David Greenfield emphasises the innovation aspect, they are still new, we are still learning and there is no one single way that MOOCs are being used. There is still a lot of space for innovation and new ideas.

Q&A

Q1) I work at the Tate in visual arts, the idea of assessment by multiple choice is very appealing so I wanted to ask about peer assessment. How did that work? Did there need to be moderation?
A1 – Jen) It is quite controversial, that’s partly as the MOOC platform don’t handle peer assessment too well. We didn’t get asked too much to remark assignments. Peer assessment can work extremely well if the group know each other or share a common understanding.

A1 – Sian) It was strange how assessment focused many people were for a non credit bearing course though, they wanted to know how to pass the MOOC.

Q2) I wanted to ask about the drop out which looked absolutely huge…

A2 – Sian) You mean people who didn’t begin to engage with the MOOC? It is problematic… there has been a lot of criticism around drop outs. But we have been looking at them from a traditional education point of view. MOOCs are free, they come in, they sample, they leave. It’s about shifting our understanding of what MOOCs are for.

Q2) What did you learn from that…?

A2) I think it would be too hasty to make too many conclusions about that drop off because of what it means to be in a MOOC

A2 – Jen) there is some interesting research on intentions at sign up. Around 60% of people signing up do not intend to complete the MOOC. I don’t think we will ever get 90% retention like we do on our online MSc. But Sian’s point here holds. Different demographics are interested for different reasons. Retention on the smaller equine science MOOC was much more about the participant interest rather than the content or pedagogy etc. The 7% retention rate was the more innovative assessment project.

Q3) We would love to have that data on drop outs. We aren’t allowed to fail at that rate in public. I work in the National Library of Scotland and we know that there is “library anxiety”.  I would hate to think this is a group with inflated library anxiety!

A3) Absolutely and I know there will be more on this later on. But its about expectation setting within the organisation.

Q3) Just getting that data though – especially the research on those who don’t want to complete – would be so valuable for managing and understanding that completion in open contexts.

Q4) Perhaps the count should be from the first session, not from those who sign up. It’s not the original email we are concerned with but the regular drop out which would be more concerning. We get people doing this with on site free experiences. This is more about engaging with the higher up decision makers and marketing about how we could use MOOCs in cultural heritage.

A4 – Sian) It was unfortunate that many of the MOOCs really marketed sign up rates, and inflated expectations from that, as a way to promote the MOOCs early on. Very unhelpful to have messages like “we want this one to hit a million sign ups!”

Q5) These aren’t credit bearing but are there MOOCs which are, how do they work?

A5 – Jen) Quite new territory. Some allow you to have some sort of credit at the end of the MOOC on payment of a fee. And some – including University of Central Lancashire – are trialling MOOC credit counting for something. Work at European level there too. But no one has cracked the magic bullet.

A5 – Sian) Two offering credit so far – one at Oxford Brookes, one at Edge Hill.

Q5) Maybe credit will appeal to those currently absent from the demographic profile – moving to those with few or no higher level qualifications

A5 – Sian) we did ask people about why they did the MOOC, many for fun, some for professional reasons. none for credit.

Q6) what are the indirect benefits of the programme?

A6 – Sian) We have had five or six people enrolling on the MSc as a direct result of the MOOC. We also got great publicity for being at the forefront of digital education which is great for the University. That indirect benefit won’t last of course as MOOCs get more mainstream but

A7 – Sian) 40 days academic staff time to develop, 40 days to deliver it. And that doesn’t include the Information Services staff time to set up the technology, In terms of participants I’m not sure we have that data

A7 – Jen) We kind of have it but it’s taking a long time to analyze it. You get a lot of data from the MOOCs. There is a whole field of learning analytics. We have the data from both runs of the MOOC but it’s hard to find the best way to do that.

Q7) Interesting, for people reflecting on their own time investment

A7) We gave guide time of 5-6 hours per week for the basic involvement but actually many people spent a lot of time on it. And there was a lot of content so it took that long to read and engage with it for many participants.

Q8) How do you assess 40k people?

A8 – Sian) Well that’s why we spent a lot of time trying to make the assessment criteria clear for people marking each other.

Q9) Can you say a bit more about xMOOCs and cMOOCs. A lot seem to be xMOOCs?

A9) There is a lot of discussion around how to go beyond the bounds of the xMOOC.

A9 – Sian) Our MOOC was seen as quite innovative as we were a bit of a hybrid, but a lot of that was about participants using social media and just having a hashtag made a difference.

Q9) So are there people trying to move out of the platform…

A9 – Jen) for the credit and microcredit courses you try to bring students into the MOOC platform as that is easier to measure. And that’s an area that is really becoming more prominent…

A9 – Sian) Would be sad is the move towards learning analytics took away the social media interactions in MOOCs.

A9 – Jen) We do see AI MOOCs where there is some opportunity to tailor content which is interesting…

Comment) Can see these working well for CPD.

:: Update: Jen and Sian’s Prezi can be viewed online here ::

The changing landscape of teaching online: a MoMA perspective – Deborah Howes (Museum of Modern Art)

It is a pleasure for me to tell you just a little bit about what has been going on at MOMA, especially having to spoken to just a few of you – I realise you are very savvy digital education, cultural education audience.

I like to start with this slide when I talk about online learning at MOMA – of MoMA education broadcasts in the 1950s. We have always been interested in technology. It is part of our mission statement to educate (the world) about the art of our time. This image is from the 1950s when MoMA had an advanced idea of how to teach art and creativity – and they invited TV crews in from Rockafeller Centre to record some of what was going on in terms of that education.

So online learning for MoMA can be as something as simple as an Online Google Hang Out working with seniors who go on a field trip once a month without them having to leave their apartment – they have a museum visit and discussing the art. Some have mobility issues, some have learning disabilities. But they have these amazing opportunities to visit and engage all the time for free. We use Google Hangouts a lot and this is an example that really hits home.

Image of Deb Howes (MoMA)

This example, like much of what I’ll talk about today, isn’t strictly a MOOC but it’s from that same open online concept and the MOOC is changing. However we have, at MoMA been running online courses since 2010. These are NOT MOOCs as we charge for them. You can take them in two ways. You can be self led and there is no teacher responding to you and there are no students but you go at your pace whenever you want. Or you can do the teacher led version with a teacher, with fellow students, with responses to your comments. We started the concept of starting these courses. We did this with Faith Harris, who now works at Khan Academy, and she was teaching online in the New York Museum of Fashion. She had a clear idea of what the format was – a structured course led by an educator. We did a studio course – how to paint – to see if that would work. That seemed such an usual idea at the time but they are really popular, especially as an instructor led experience. They like to see and share progression and to get feedback on that. Just like a real studio experience. So the “how to” videos, one of the things we tried to replicate online was the feel of exclusivity you have in an on-site course. If you enrol in person you get to paint in our studio then you get access to the galleries when no-one else is around. So here we have Corey Dogstein and he’s also an artist, the students love him, but you can see this video of how to paint like Jackson Pollock and really get into that free form, jazz playing vibe.

My previous role I came from a gallery where I had no idea who was doing my tour, or what they were getting from it, then I was in an academic place where I knew who everyone was, how they were progressing, assessing them etc. So in this role the online teaching experience has been really interesting. In particular taking out the temporarility and those barriers to speak up, you open up the accessibility to a much much wider audience. The range of learning difficulties that students come in with and feel able to participate online, that wouldn’t feel able to participate as fully in person is striking.

We use a course management system called Haiku. No matter what you do it looks like a bad high school newspaper. It organises content top to bottom, welcome messages, etc. 60% of our students to the MoMA online course have never taken an online course before. They tell us they’d rather try it with us! We have a lot of first timers so we have to provide a lot of help and support. We try to make them engaging and lively. The upside of the highly controlled space is that the teachers themselves are making these courses, it’s easy for them to change things, that’s the upside.

We try to think thematically about content, rather than thinking academically along a timeline say. So colour as a way to explore modern art came to mind, and also broadens the base beyond painting and sculpture – design and architecture for instance. So this way we can interview the curator of design, Paula Antonelli, on colour in design. [we are watching a clip of this]. Talk about exclusivity! Even on my 11 o’clock tour I couldn’t get you time with Paula. The students really respond to this. And we also created videos of the preservation techniques around colour.

This course: “Catalysts: Artists creating with sound, video and time” brings all those ideas together, and is a hybrid xMOOC and cMOOC although I only just realised this! We got the author Randall Packer to put this history together using artefacts and resources from MOOCs. It’s so hard to do this history – why read a book on the history of video artworks?! As an educator how many museums have the space to show a whole range of video art? Even at the new Tate underground you have a rotating collection. Rare to have an ongoing historical way to explore these. One of the reasons MoMA was able to jump into online courses feet first, is that Volkswagen are a corporate sponsor of the galleries and were keenly supportive. And as part of teaching the Catalyst course Randall, who is also a practicing artist, thought it would be great if we could get students to make and share work, wouldn’t it be great to make a WordPress blog they could use to share these and comment on each other. And my colleague Jonathan Epstein suggested digital badges – they get a MoMA badge on their blog and badges for LinkedIn profiles etc.

So, over three and half years we’ve registed about 2500 students. Small versus MOOCs but huge for us. Around 30% of enrolees are not from the US and that 30% represents over 60 countries. For us it was about engaging people in a sustained way with people who couldn’t come to MoMA or couldn’t come often to MoMA, and we really think we’ve proved these. This is one of those pause moments for us… so, any questions…

Q&A

Q1) That quote on your slide “the combination of compelling lectures with the online galery tours and the interaction with the other students from around the world was really enlightening and provocative” – what do you learn from these participants?

A1) We do find students who set up ongoing Facebook groups for instance, and they are really active for a long time, they will go on a trip and write to their peers about what they’ve seen. We learn whilst they take the course, but also over time. What is so hard for museums to learn is what the long term impact of a museum visit… there is no way to know what happens months or years later, or when they are at another gallery… But you get a sense of that on the Facebook groups.

Image of Deb Howes (MoMA)

Q2) At the moment it’s $25 to come into MoMA. How much are the courses?

A2) It is. But it’s a sliding scale of prices. For self-led courses… 5 weeks is $99 if you are a member. or $150 for a non member (of the museum) 10 week course. For instructor led it’s $150 to $350 per course depending on time etc. They may fluctuate, probably go down. I like the idea of a cost recovery model. Free is hard for me as instructor. But there is a lot of free stuff, and especially in the MOOC world, they are comparing what’s available, what the brand is worth, which is worth doing.

Q3) Member?

A3) Of the museum. Typically at the museum you get lots of discounts, free entry etc. as part of that. I think it’s about $75 for an individual membership right now and that’s part of a wider financial ecosystem I don’t get into too much.

So… we have all these courses… We got contacted by Coursera who said “oh sorry we can’t take your courses as you don’t award degrees” but here is a sandbox for K-12 for you. In fact MoMA does a huge amount for teachers. We had just done a huge new site called MoMA Learning with resources for all sorts of classes. So we thought, well this will be our textbook essentially. If we leave it there we don’t need to renogiate all the content again. So we decided to do a four week “art and inquiry” MOOC. There is a huge focus in the core curriculum on discussions around primary source materials, we do a lot of training of teachers but we can’t fit enough of them in our building. We have taught a class for teachers around the country, perhaps beyond, who come for a week in the summer and talk about inquiry based learning. It just so happened when this came together that we were the first MOOC in the primary and secondary education sandbox – I think that has everything to do with why we had 17k ish participants. We had a “huge” engagement ratio according to Coursera, they told us we were off the charts – people are watching the videos “all the way to the end!”. Huge validation for us, but if you think carefully about all the ways people are learning that satisfy them, people look for something to engage with – and museum educators are great at this, great at finding different ways to explain the same thing.

At the end of the course we had a survey. 60% were teachers. The rest were taking the course for different reasons – doctors wanting to talk about x-ray results better with patients. 90% of all those who answered the survey had not been to MoMA or had an online MoMA experience but they did visit the website or site afterwards. We had more friends, we had people following and engaging with our social media. It was a wonderful way to have people access and engage with MoMA who might now have thought to before.

So I have a diagram of MOOC students. It is kind of Ying-Yang. The paid for courses tend to be my age or older, highly educated, have been to many international galleries. Coursera they are 20-30 year olds, it’s about their career, they take lots of Coursera courses. And what struck us was that putting our content beyond the virtual museum walls, people really want to engage with it. In the museum we want people coming to us, to speak to us, but here they don’t visit us at all but they still want to engage.

We had 1500 students get a certificate of completion. In MoMA we have 3 million admissions per year. I have no idea how many take that information with them. For me as a museum professional 17k people made an effort to learn something about MoMA, word is out, and I taught 1500 teachers in the way I would like to in an academic way, and I taught more than I could teach over three years, but in one single summer. And the success of that means we have followed up with another MOOC – Art and Activity: Interactive Strategies for Engaging with Art. The first one runs again soon, this new course runs from July.

There are a few other things we do online… MoMA Teens Online Course Pilot. This was a free 5 week course in art appreciation at MoMA. These were teens that had taken probably all our teen courses as part of after school programmes. They brought back to us this Real World MoMA episode. [very very funny and well full of art in-jokes].

You get the idea right? I should just let the teens do all the videos! We have a new group of teens coming in doing a completely different thing. This is their medium, they understand. They combine the popular with the collection in an unforgettable way, the kids will never forget these five artists they focused on.

I just want to go through some pedagogical background here. There is a huge body of really interesting reseach on how the brain works, what makes memories… One of the things I always try to think about is what makes your brain remember, and why a museum is such a great way to learn. So one thing that is that you learn when something new comes in – a new sight, a new sound, a new smell… Museums are like that. They are new experiences. For children they may never have been to a museum or even to the city before. I try to make the online courses take that into consideration. How can we do that, and make the brain hold on to what it being learnt?

I don’t know if Howard Gardner is familiar to you? His ideas that different brains work differently, and that we need to present material in different ways for different people. We have hands on aspects. We have scientist experts, we have critics… we try to present a range of ways into the material.

So here also is some student feedback – the idea that there is more in the course than can be absorbed but that that is a good thing. We also try to ensure there are peer to peer aspects – to enable sharing and discussion. So here we have the learning communities from that studio course – where participants share their art… increadible learning experiences and incredible learning communities can exist beyond the museum and beyond the university but it is great to be there to support those communities – to answer questions, share a link etc.

I wrote a post you might like: moma.org/blog search for “how to make online courses for museums”

Moving forward we have a couple of hundred videos on YouTube but we were asked if we would put these into Khan Academy. We filtered the best down, gave them embed codes, and they have created a structure around that. As a museum you don’t have to do everything here, but reusing is powerful.

And moving forward we are doing some collaborations with the University of Melbourne.

And my forcast for Museum-University Partnerships forecase? Sunny with a chance of rain! There are real challenges around contracts, ownership etc. but we can get to a place of all sunny all the time.

Q1) We would be developing online learning as a new thing. When you decided to go down the online route did you stop anything else? Did you restructure time? How does that fit with curator duties?

A1) We didn’t drop anything. The Volkswagen sponsorship allowed us to build the team from myself and an intern to include another individual. But it’s a huge time commitment. Curators don’t have the time to teach but they are happy to talk to camera and are generally very good at it. I was at John Hopkins, and previously to that at the Metropolitan Museum… I was used to having media equipment to hand. There wasn’t that at MoMA but we created a small studio which makes it easy for curators to pop in and contribute.

Q2) Could you say a bit about the difference of practical versus appreciation type class?
A2) for practical classes the key is *really* good videos. Being able to replay those videos, if shot well, is really helpful and clears up questions. It lets them feel comfortable without asking the teacher over and over again. If you’ve ever been in a group critique that can be really intimidating… turns out that the level of distance of photographing your work, post online, and discuss online… students feel much better about that. There is distance they can take. They can throw things at the wall at home as they get critiqued! It is popular and now online you find a lot of low price and free how to courses. But our students who return it’s about the visits to the gallery, the history of the gallery, connecting the thinking and the artwork to the technique

Q2) So unspoken assumptions of supplies available?

A2) No, we give them a supply list. We tell them how to set up a studio in their own bedroom etc. We don’t make assumptions there.

Beyond the Object: MOOCs and Art History – Glyn Davis (University of Edinburgh)

Our final speaker is one of the “rock star lecturers” Jen mentioned!

So, in comparison to the other speakers here the course I have been preparing has not yet run. We have just under 12000 signed up so far, we anticipate around 20k mark. I am an academic and I teach film studies, particularly experimental cinema. A lot of the films I talk about it can be hugely hard for people to get hold of. That presents massive difficulties for me as a researcher, as a writer, but also for these sorts of learning experiences.

Where I want to start is to talk about Andy Warhol. A book, Warhol in Ten Takes, edited by myself and Gary Needham at Nottingham Trent University. We start with an introduction about seeing a piece called “does Warhol make you cry?” at MoMA – and he was at the time. So many rights to negotiate. That book is solely about Andy Warhol’s cinematic work, focusing on 10 films in detail. Those that are newly available from the archive, those where there was something new to be said. He only made films for five years – making 650 movies in that time. A lot even in comparison to Roger Corman (5 a year or so). Some are a few minutes long, some many hours. The enormous challenge was that in 1972 Warhol took all of his films out of circulation – he wanted to focus on painting, he was getting sued a lot by collaborators who wanted money from them. And they remained that way. Just before his death he said “my movies are more interesting to talk about than they are to watch”. He may have been joking but that sense has hung around studies of his work. Take a film like “Empire” (1964) it’s a conceptual piece – 8 hours and, in terms of content, time passes and it gets dark – has been little shown. Very few of his films are in circulation. MoMA has around 40 circulation copies available but that’s a rare place you can see them, you can see screenings at the Celeste Bartos screening rooms. The only other place to see them is at the Warhol museum in Pittsburgh on VHS. If not that its 16mm. You can’t pause or rewatch. It’s cold. It’s really hard to do Warhol research… so many pirate copies also out there…

12751417225_a7c167590f_z

So are his films worth seeing or are they just conceptual pieces? Since the films have started to come out of the archives films like Empire have been shown in their entirity… people then discuss the experience of sitting through all of them. Indeed in his PhD thesis (Motion(less) Pictures: The Cinema of Stasis), Justin Remeselnik suggests they are “furniture films” – you can admire and engage with them but not to be paid attention to for an increadibly long time… and yet in Pamela Lee’s book Chronophobia talks about seeing Empire the whole way through, as a phenomenological record of pain it’s fairly incredible. She’s not alone here… another writer, Mark Leach, asked an audience to provide live tweeting during a screening of Empire, and then compiled these into the book #Empirefilm.

This is a long diversion but… Gary Needham and I tried to think hard about the experience of the Factory and the working environment there, what was it like to see Warhol’s films in the context of other experimental filmmakers in the 1960s. In trying to put together a MOOC these ideas sat with me, as the rights negotiations for the book took place over 18 months. We had 30 new images created – we had to apply for grants to get these made, rather than reproduced – by the Warhol museum. We had materials from BFI. We were able to use publicity materials as well. And we had to get agreements from so many people. The Whitney Museum has a Warhol Film Project and acted as our fact checker. It’s a 500k word book so that took some time. One of Warhol’s assistants, Gerard Malanga, allowed us to use his diary entries in the book. I came to Warhol knowing the rights access issues. And I came to the MOOC knowing those issues, knowing the possible time lag…

Chris provided a great introduction to Artist Rooms earlier. I head up the Art and it’s Histories strand. Sian and Jen head up the education strand but I work with artist historians and theorists doing research projects around the materials. So making a MOOC was an idea we thought about as a way to bring out Warhol to a wider audience, and to highlight the Artist Rooms content. I had a lot of questions though and I knew we could not use moving images at all. Could we talk about Warhol’s work without images or clips? What does that mean? Can we assume that people taking the course might source or be able to watch those things. I’ve been teaching Warhol for 15-20 years. I can show all manner of images and clips to students for teaching which are fine to use in that context but which would be impossible to use online for copyright and provenance reasons.

So, there are roughly 250 Warhol pieces in the Artist Rooms collections. There are particular strengths there. There are a great number of posters, as Anthony d’Offay said to me, these give a great overview of events during his lifestyle. There are also stitched photographs – another strength – and these are from the end of Warhol’s career. There are not many so to have a number to compare to each other is great. There are also early illustrations and commercial works. And there are self portraits from the early to mid 80′s. So for me how do I put together a course on Andy Warhol based on this collection? His most famous work is all from about 1962 to 1966. These pieces are silk screens of Monroe, Electric chairs, guns, Campbells soup cans. They are hugely expensive and not in the collection. But are these so familiar that I can assume those taking the course will know them. But the other partners in Artist Rooms – from the National Galleries of Scotland and the Tate – that did cover some of this famous 1960s material, to sex up the course a bit!

So this let us take shape. This will be a five week course. Each week will be a video lecture from me (sex, death, celebrity, money, time) and then a video interview who have worked with Warhol’s work in one way or another – curators, academics, conservators etc. Who could give a fresh perspective on Warhol and what he means to them. I’ll come back to them shortly.

I’ve talked about Warhol’s ubiquity and that’s been an issue as we finalised materials, looked at editing videos. Warhol is one of the most well known artists in the world. His images circulate so widely on such a range of objects (maybe only exceeded by the Mona Lisa) that familiarity with them is high. You can buy just about everything – from mugs to skateboards… the Warhol story is extraordinary. What’s really interesting for anyone teaching art history or theory is that he provides a really interesting test case with regards to reproduction and distribution.

For instance the Marilyn Diptych ( Andy Warhol, 1962). This was based on a publicity still for the 1953 film Niagara which he cropped to his liking. He started to make works just after her suicide in 1962. They have been described as work in mourning. And they are important examples of pop art, collapsing the worlds of art and pop culture. But also commenting on the mass media reproduction of imagery. The uneven application across this piece suggest the blurring of images in newspapers, and the important difference between similar reproductions. Thomas Crow (in his essay for Art in America (May 1987), “Saturday Disasters: Trace and Reference in Early Warhol”) writes that Marilyn disappears quickly when you look at this work, what becomes clearer is the blurrings, the paint level variations. But I have been using this image to teach with Walter Benjamin’s essay on mass production in relation to art work. His essential argument is that endless reproduction, owning of facsimiles etc. changes our relation to the original. It could seem less valuable… or more valuable… as we have seen with Warhol’s work. And Warhol’s own work is a reproduction itself of course. And his painting is the valuable thing… not the press still…

Being able to talk about this work and reproduction through the MOOC and the digital format adds another layer. MOOCs raise the question of what the use of gallery visits may be. What’s the difference of talking about a work and engaging with the original piece. The process of art or art history has always involved travel to galleries, biennials, festivals. Writing about it means seeing the work, there are financial angles there, there are green angles there. For example I am going to Newcastle for three days to see “Crude Oil” (Wang Bang, 2008). It is a 14 hour movie, you can only see it in installation. I intend to move in… my husband thinks I’m mad!

And what about the experience of engaging with the stuff here. I spent three days at the Warhol Museum in Pittsburgh preparing for the MOOC watching to VHS, speaking to staff, and also looking at Warhol’s “time capsules” – receipts, ephemera, e.g. a box from 1978 is just “Concorde stuff”. I was accompanied by a curator, they opened boxes for me… some smelled bad due to moldy stuff, exploded soup cans, a still-inflated silly birthday cake which was a present from Yoko Ono. They are treated as art works. They are still cataloguing these things. So I spoke to the curators about how they are making the time capsules educationally engaging. They have video of celebrities going through them, for instance John Waters gives a great critique of one of the time capsules. They did a live opening, streamed to the ICA, of one of the time capsules. I mention these because these were really interesting examples of opening this type of content and artist up to others.

Let me just say a bit about how we have made the videos for the MOOC. My colleague Lucy Kendra who had filmed other MOOC content saw this filming experience as unusually immediate and intimate in form. We spoke to curators and conservators at the galleries, Gary at Nottingham, and Anthony d’Offay himself. We were also given access behind the scenes at the Tate Store – they took out 10 pieces as a backdrop which was so valuable. We had interviews of an hour, an hour and a half. We have so much materials. For the Warhol class there will be a required 10 minute version of the video, but we will then give a longer, possible unexpurgated, videos for those that want to see them the whole way through. These are fantastic and extraordinary videos. I think they are fantastic representations of these institutions but I think it may open the doors to careers in some of these roles. We hope they may open doors in ways other art education courses may not do.

These interviews I could not have forseen, but they have become the bedrock of the course, the USP, the main draw, and these first time perspectives on the artist and his career. Why Warhol is still of interest and the personal interests of the interviewees themselves. We started by thinking the issue would be about content and rights but the interviews have gone beyond the object there.

Image of Glyn Davis (University of Edinburgh)Q&A

Q1) Will there be assessment at the end? Will they be assessed by peers.

A1) Yes, I think there has to be for Coursera. I have PhD student Teaching Assistants. I have left some of those decisions to them. They have suggested allowing practical responses to the materials – to get a sense of materials and present day materials, contemporary approach. Or a short written text, a 2-300 word response to a work of their choosing – perhaps from Artist Rooms or perhaps another. These are great TAs though with ideas like building a map of the nearest Andy Warhol to the participant, opening up possible discussion of access. Peers will assess the work and this is where drawing on the expertise of colleagues who have run MOOCs before is so valuable.

Q2) When we did our MOOC we had an easier rights time but we really wanted to use films that it was hard to find legal clips to… we avoided anything we knew was of dubious origins. But we found students sharing those clips and images anyway! What do you plan to do with that?

A2) As far as I know the Warhol Museum in Pittsburgh are well aware that material leaks out… if our participants link to those things we can’t help that. We just create that distance and leave that in the students hands.

Comment – Debs) I feel your pain entirely! In addition to the academic excellence issue, at MoMA part of our job is about preserving the identity of the work, of the artists in our collections. We can’t distribute unofficial copies of works by artists in our collection, it wouldn’t look good. And yet… we were one of the first museums to go to Electronic Arts Intermix about using video online. They’d never really been approached to digitalise their works in that sort of context. The first person I spoke to was extremely pessimistic about these once-cutting edge technology using artists works being able to share these works online. We were able to say that in the environment of this course – a limited course, not a MOOC, we have a lot of details on them – it is very comparible to the classroom. We stream it and although you probably could capture the content but most won’t. They were OK with this. We got Bill Viola, Yoko Ono, etc. allowing us to stream the content. It was costly… but I hope as we push these boundaries more the artists and rights holders will go with that. Otherwise we will have a loss to art history and accessing this hard to reach art. That arguement of the most famous work being the most visible already is one I’ve used before, I hope that rings true.

Q3) Do you have specific goals – educational or a specific combination of enrolees – for this MOOC?

A3) There are two or three key goals. Part was a partnership between the university, the Tate and National Galleries. And part of that was about trying a MOOC as a way to do that. It might be that the Tate or National Galleries want to use one of those interviews somewhere else too. For me it is also about trying a new tool, and what is possible with that. I am interested in testing the boundaries of what Coursera will do.

Q4) With the MOOCs which you have completed… with hindsight now is there a lot that you would do differently?

A4 – Deb) Not a lot but… with the videos I wish we had done differently. I wish we had done them straight without “last week you did X”, or interviews with curators etc. I wish I had had the insight to bring in the right people or to make it more long term useful.

A4 – Sian) for our second run we did make changes. We refused to make videos the first time, we were being hard line. But the dominent comment online were “where are the professors” and “where are the videos” so we made introductory videos for each week. That was the most significant change.

And with that a really interesting afternoon is complete with thanks to organiser Claire Wright, and to the Royal Society of Edinburgh for providing funding for the event.

Find out more

Share/Bookmark

Multimodal Profusion in the Massive Open Online Course – JISC Digital Literacy Webinar with ALT (LiveBlog)

Today I am connected to one of a new series of JISC and ALT (Association for Learning Technology) Digital Literacy webinarsMultimodal Profusion in the Massive Open Online Course – Jeremy Knox, Sian Bayne. 

I will be taking notes throughout the session and hopefully catching many of the questions etc. As usual this is a liveblog so my notes may include the odd error or typo – please let me have your thoughts or corrections in the comments below!  

:: Update: the recording for this session is now available here ::

According to Lesley Gourley’s introduction these sessions are all being recorded and being made available online via the ALT website. These webinars are based on forthcoming papers in Research in Learning Technology – Special issue on Scholarships and Literacies in the Digital Age. Beyond practice and into greater overarching change. This will be out towards the end of the year.

Lesley is introducing Jeremy and Sian. Sian’s research interests are related to teaching and learning online, particularly around post humanism and multimodal academic literacies. Jeremy is working on a PhD on critical post humanism in open educational environments.

We are beginning with Sian: We will be building on work we have done in our E-Learning and Digital Cultures MOOC and looking at how we can theorise what we have encountered there.

The E-Learning adn Digital Cultures MOOC has just begun it’s second run. It initially ran in early 2013 with around 27,000 students and is running again, launched this week, with around 19,000 students. And we have tried to see this as going beyond the classic MOOC lectures. Instead we have curated open educational resources, web essays, etc. alongside theoretical work and educational thinking. And we then encourage participants to blog their thoughts. We have discussion forums but we also encourage them to use Twitter (#edcmooc), to blog their experience… influenced by the cMOOC design than by the conventional xMOOC design. And we saw before – and are seeing again – a real sense of community development. We see very active Facebook group (4500+, G+ group (3800+) etc.

Jeremy: For me one of the ways in which this sort of massive participation seemed to manifest was in the submission of final assignments to the EDCMOOC. We had over 1700 artefacts submitted. We asked them to create something that commented on one or all of the course themes, something creative designed to be experienced on the web. What was really interesting to me was that in that requirement to make the digital artefact public… we initially did that so that we could use peer assessment – using the peer assessment module – and in order for that to work, and to mirror the public open pedagoguey we were trying to use. But as a result this digital creativity began to be collected and curated on the web. So this image we see on the screen – a Padlet page of 330 artefacts – but you get this profusion of digital creative work. That’s significant because not only is assessment usually hidden, it is also usually private. But this is really open and collaborative as an experience.

And that really led to us thinking about this as “sociomaterial”. This is emerging in some educational research (Fenwick, Edwards and Sawchuk 2011) and encompasses ANT, Complexity Theory, Cultural Historical Activity Theory and Spatial Theory. So we wanted to think about this as a way of percieving relationships between humans (the social) and non-humans (the material). The relation is all important here as this perspective is about disregarding form before the relation, instead seeing the relation between these things as the key focus. I like the idea of Karen Berad who talks about “inter-action” but if we talk about “intra-action” we talk about those things without having to regard them as pure forms.

So why the sociomaterial? Well it counters what can be seen as an over-emphasis on human agency, particularly in digital literacy discourse. The idea that technology is just there to achieve educational goals – an approach that overlooks the role of technology and the change or influence it can have. And it also responds to the idea that online environments are “virtual” or somehow “immaterial” – we are moving to a place where the web is something real and tangible. And when we get to the idea of things being tangible we can get to a place where we see things as situatable to education events. And it offers an alternative way of understanding knowledge – what it is and how it comes about. This isn’t too philosophical but part of the day to day work of educators and the sociomaterial has some profound insights here. And it allows us to acknowledge ways that software and algorithms co-produce digital work (rather than being simple “tools” for human use).

Sian: At this point we thought it might be useful to say what we mean by digital artefacts, those created with a sort of sociomaterial literacy. So I thought I would show a few examples. Firstly “Twitterchat by cikgubrian” on YouTube which brought together and aggregate an assemblage of impressions of the EDC MOOC. Next up “My Scottish MOOC by Willa Ryerson” – another animation about the experience of the Scottish MOOC. Finally “Our #EDCMooc Experience: Class? Network? Something Else?” a “Haiku Deck” using images and text comments. Now Jeremy will do a more detailed reading of some of these artefacts.

Jeremy: I want to provide more of a detailed overview of how these might be looked at as sociomaterial objects. firstly “World Builder: a crowd-sourced tag heart” by John O’Neill. This was created with a tag cloud tool. What struck me was that this was submitted as a piece of work to be assessed for representing a theme of the course. It is put forward as a stable contained piece of work. But I want to look at the processes to produce it… which question it’s source and finality. It’s a sociomaterial reading that enables us to do this. So this text was produced in the responses to a video used in the course called “World Builder” about an idealised virtual world for someone apparently in a coma in hospital. So this text is from around 85 posts in a forum thread from about 75 identified participants. So it was this participant who took this text from the forum. A number of the responses addresses specific questions that we as a teaching team put forward, so our text not only informed that discussion as well. so the distributed elements were not just discursive but there were technological and algorithmic elements that shaped these texts. There are a number of automatic process that take place on this text. Several interesting variables come into play here. The scale of font to relative frequency is adjustable. The tightness regulate how tightly the words fit into a shape. But there are also factors that are automatic algorithmic changes – like removal of small words, combining of tenses, sometimes plurals. These are encoded into the software. And there is the heartshape as well… which determines location and proximity of words. So this seems to embody the symbolic from the material in this. It is a hybrid object, a continuity of matter and culture here. Social and material are not distinct. And as significant as the contesting and blurring of origins, also it’s stability and finality of the object is under question… it was submitted as a Flickr image, also in a Wallwisher, also on Tagxedo website. On the latter website each word is a hyperlink. That really blurs the status of the object as final for me.

And the second example is “E-Learning and Human 3.0″ by Nick Hood, created by VideoScribe. It’s a presentation software using text and an animated hand. Once again this presentation has come about from some really interesting and layered process. So the user inputs text and positions it within a sort of whiteboard space. And select from some existing images. And you choose a sort of “preferred limb” for writing. This represents an archetypal black box of digital creation. A tension between software accessibility and usability – this software is clearly both accessible and usable – and on the other hand a kind of openness and user agency. The user doesn’t have fantastic control. That tension is also about absence and presence… the hand is a sense of presence, the spatial aspect of the classroom that draws on the idea of whiteboard. But the surface layer conceals non human agencies at play.

So firstly I wanted to touch on the idea of the image of the hand. So this is a screen capture of the video options – the limb or writing implement – you’d like to animate your presentation with. Most are arms, some are instruments, one is a foot. So you enact a teaching body different from the author – you are distributing the teaching body. And also the hand is animated with the software that preceeds the software. The teaching body is performed by this really complex assemblage of bodies codes, and texts. These are co-constituantly non symbolic. The teacherly body is human and non human at once.

The other thing is this straight forward way of simulating the classroom space. this was submitted via YouTube, where the video has algorithmically generated suggestions. And it will consider the viewer currently watching as well as other viewers of this video – and what they have looked at. This is complex and ongoing algorithm of human interaction that persistently changes that page and that video. Elements are rearranged, reordered, constantly reproduced by humans and algorithms. Human, body, algorithm and non human actor are all present and interacting.

Sian: so I guess we want to end with implications – what does this all mean? Jeremy picked on two of thousands of artefacts to think about how they fit into code, algorithms and agency. Some themes here:

Non-representationalism – seeing knowledge not as something re-produced or re-created outside of a situation (the human min) but instead knowledge is within and part of enacted relational process. Does the artefact convey the intentions of the author? It is about a more complex performance involving both the person and the alogorithmic elements. A new way to understanding that.

Anti-anthropocentrism – the decentreing of a human or human author as the authentic single author of a digital work, it is problematised, this idea of technology in our service… instead it is about decentring the subjtec allows to move beyond an instrumental view of technology and simplistic ideas of empowerment. It helps us interact criticism. So for instance that tool used by Nick presents all limb options as white, forcing us to think critically about that. So we have fundamental issues to consider here.

Both artefacts are i nteresting, we could have spoken about hundreds of examples. Our overarching point is to see digital literacy as something other than technical mastery, instead theoretical areas that decentre human intention.

Jeremy: So some conclusions to add to some of that. I find it interesting that in much digital literacy work you see this emphasis on skills training and future proofing. The idea of training, especially in schools, to enable students to be competant citizens for the futrue. Interesting to consider that in the context of anxiety and fear in relation to technology. Perhaps this may be a response to the loss of stability and authority in digital space.

We see the digital artefacts of the EDCMOOCs as a demonstration of complex, contingent, specific and relational sociomatierla practices.

The resulting knowledge might be considered a collective enactment of human and non-human agencies. Context matters here.

And this perspective gives us a new way to look at digital literacies. We see technology as having a role that expands further to the wider social, cultural and technological contingencies which shape work produced in educational contexts.

Q&A

Q1) Are YouTube videos on any channels?

A1 – Sian) We can share a list of the videos included here. I can also send around some sites where MOOC students have tried to crowdsource and curate these.

Q2) Interesting interpretation: how close is your relational-sociomaterial stance to Siemens and Downes’ Connectivism

A2 – Jeremy) Siemens and Downes are doing good work updating the social constructivist view of MOOCs up to date. For me it’s about how technology is perceived. A lot of the connectivism work slips into an instrumentalist view of technology as there to inform connections. Sociomaterial perspectvies takes a more nuanced views. Siemens has talked about “non human devices” so there are some interesting cross overs. But the view of technology is where they don’t quite correlate.

A2 – Sian) Connectivism making some great work and shifts in terms of pedagogical design but yes, still about being anthrocentric, less focus on the materiality of those networks. That is the slight difference for me than the sociomaterial approach we’ve taken here.

Q3) Why Collaborate rather than Google+ Hangouts

A3 – Lesley) ALT’s preferred method due to numbers.

Q4 – Nick) Is there any aspect of your research that considers the teacher as assessor and how aligned the teachers digital literacy has to be with the student’s digital literacy. Some students submit work that could be challenging to assess in terms of what parts of that work are the students’ own work versus the choice of tool use, to be able to interpret what the students content is?

A4 – Sian) Such an important question. Partly about teachers knowledge and understanding. Partly about what the tool can do. But it also troubles the notion of assessment. And it troubles the frameworks of assessment in particular – those are grounded in textual history, but this is much more about interpretation and the interpretation of the teacher. We are as much taxing our interpretation as the students skills. It questions intentionality.

A4 – Jeremy) A great question. The sociomaterial reading really questions if we can really assess the skill of the author or the skill of the algorithm. The YouTube recommendation algorithm… we don’t need to work out exactly what it’s doing, not the point, but it’s about showing it as entangles and enmeshes, the algorithm isn’t a purely material form, you can’t separate out the intention of the author. And that really troubles identifying and assessing achievements. Interpretation is an interesting way to move that forward.

Q5)  What criteria do you use to assess the students artefacts or creations?

A5 – Jeremy) These were peer assessed. We defined some criteria within the course and asked students to peer assess each other’s work. Students submitted the URLs. the software allocated the URLs to three students for feedback and grading. We were really experimenting with peer assessments. We weren’t trying to impose a sociomaterial assessment, these are a response to that process.

A5 – Sian) We drew on experience of peer assessment from the MSc of eLearning. The criteria wasn’t sociomaterial exactly. There is another aspect of form here, ideally we would respond in the same form as the submitted artefact.

Q6) Is the Edinburgh MOOC a cMOOC? And I’m not clear on the difference!

A7 – Jeremy) A cMOOC is a connectivist MOOC, the likes of Siemens, Downes and Cormier who were experimenting with open content and assemment. They were the original courses called MOOCs. Later Coursera, EdX etc. created platforms called MOOCs, called xMOOCs to distinguish from cMOOCs. So cMOOCs more radical and distributed. xMOOCs hosted centrally, usually established universities, high profile. I’m not sure we were either. Not convinced either is a valid way to talk about MOOCs. When xMOOCs first emerged… the first wave contained video lectures and quizzes in the first wave but actually things are moving on – Sian has been doing some work on this – but we weren’t really either. We wanted to combine interest in experimentation with Coursera platform.

A7 – Sian) Myself and Jen Ross have been doing some work for the UK HEA about MOOC pedgogies. No-one really talking about xMOOCs or cMOOCs so much anymore. One message out of that is that in the UK only really hybrid pedagogies in the UK.

Q8) In terms of digital literacy… perhaps the issue is that we are not sure what literacy means in any context.

A8 – Jeremy) Robin Goodfellow has done some great work on what we mean when we say “digital literacy”. We were taking a slightly different approach and rethink the idea of the human at the centre. See Sue Thomas’ interesting work on the complexities of literacy, of transliteracies. The complexities and factors here. Again that work for us… that still has the idea of the tool as something separate from the person using it.

A8 – Sian) I’d agree that literacy is an increasingly problematic term – Robin has done good work here but we have terms like “emotional literacy” etc. Some real muddiness not for researchers

Q9 – from me) In terms of critiquing digital literacies how much of what you critique of the instrumental approach is actually grounded in pragmatic needs of policy makers, funders, etc? Whilst skills based approaches are problematic, they are actionable for those decision makers. How would more sociomaterial approaches be actionable in terms of policy, in terms of ensuring critically skilled students/individuals?

A9 – Sian) I think you are right, skills based approaches can be addressed by policies but they construct literacies as deficits, so it’s about rethinking about literacy as capacities. To think again about how technology plays an active partnership in the way meaning is constructed. Hard in terms of policies but lets us move away from the idea of deficits and competencies…

A9 – Jeremy) Great question. It makes me think about the issues of literacies as a driver for MOOCs, efficiency gains etc. For me that question is great because it points to much wider institutional and political factors at play and the wider discourse around elearning.

Q10) Will you run the same course again?

A10 – Sian) We intend to offer it three times. We have made small changes this time and possibly again… but after that… well MOOCs are moving so quickly. I’m sure we’ll want to ride whatever waves are coming next…

A10 – Jeremy) There was a particular MOOC moment and I feel priviledged to have been teaching in that moment. As a team we would be interested in working at the critical edge of what is happening, not sure MOOCs will be in the near future. To add to what Sian said we had a lot of feedback on teh first MOOC. Around 60% of the first wave students worked in education and we have used their feedback. We shall do that again. But we also like to surprise people so we look forward to the third MOOC!

Q11) Seeing how different and personal those artefacts are for each learner, is it possible to define any sort of ‘common’ digital literacy, or would it be different for each person?

A11 – Jeremy) Yes, I think it really questions that idea… that distribution of agency and creativity. So many people were involved in creating that word cloud, including us as teachers. Of course the author plays a significant role in that particular coming together. But yeah, it definitely questions that.

A11 – Sian) I’d agree with that. That’s whats exciting about these academic forms, that can’t be flattened like traditional academic forms. And questions what we do when we assess academic work.

Q12 – Nick) I was just wondering about the different knowledge that participants arrive with… the issue of literacies and how they change, it moves all the time

A12 – Sian) It does really move, really question assessible terms

A12 – Jeremy) That relates to the earlier question. It is so situationable. It is not assessable to generalisable criteria really. if we think about these as singularities it is tricky to see how you might understand them and how important the situation they come about through.

Q13 – Lesley) I’m interested in what you’ve been talking about in terms of representation, assemblages and how they may be critiqued. The loss of some sort of shared code. When we think of masters or postgraduate level works, how do you engage critically with say that heart shape word cloud.

A13 – Jeremy) for me the sociomaterial reading is a way to be critical about what happened in order to understand how that artefact came about. It is about recognising the author and the decentering of that author… not a flattening out of considering what’s important and powerful and not represented, just a way to think about what is important, what is powerful in that coming together.

A13 – Sian) I think lesley and others may be interested in the ESRC Seminar Series that Jeremy and I are involved in around code in educational practice.

And with that we draw to a close with thanks to the speakers and facilitators.

See also:

 

Share/Bookmark

eLearning@Ed Conference 2012 LiveBlog

Today I am at the eLearning@Ed Conference 2012. This is an annual event focusing on experiences, innovation, and issues around elearning and based at the University of Edinburgh. As usual this is a live blog and will likely contain typos and occasional errors – do leave a comment if you have a correction!

Please note: the LTS team are livesketching the day with an iPad today as well: http://tweelearning.tumblr.com/

::: Updated – you can now view all presentations here :::

The schedule for today (and these will be updated and transformed into headings as the day progresses) is:

Welcome – Professor Dai Hounsell, Vice Principal Academic Enhancement

It’s lovely to be here this morning and to be reminded of how wonderful a place to work this is with such a creative and innovative community. And this is such a wonderful Edinburgh title “Pushing the Boundaries, Within Limits”. Indeed you may recall a campaign for Glasgow called “Glasgow’s Miles Better” and someone created a mini local Edinburgh one “Glasgow May be Miles Better but Edinburgh is Ever So Slightly Superior”.  But that note of caution is sensible. There has been so much talk about how elearning is going in mainstream that we can lose sight of how

We are pushing boundaries but then what sits within those boundaries is really changing. The University in 2012 would be unrecognisable to someone stepping out of a time warp from 1992 say. I think many of our practices and notions of what makes good teaching can be the consequence of old ways of doing things. That’s part of the challenge of breaking boundaries. A lot of our boundaries are part of the past. If we had started with word processing rather than pencil and paper would feedback have become a thing we do after the fact? And if we think about collaborative learning it really challenges some of our colleagues in terms of what they think is right or fair, some funny words can come back in response like “collusion”. As an aside a colleague speaking in Scandinavia found there is no word in Swedish or Danish or Norwegian for “collusion”, it’s all just “collaboration”.

When our colleagues get nervous about the possible downsides of students collaborating together we have to recognise that they won’t change overnight but we also have to realise that it’s valid and right to push them. And on that note I shall hand over to Wilma.

Wilma Alexander, chair of the eLearning Professionals and Practitioners Forum is welcoming us and telling us that eLPP is changing it’s name officially today to eLearningEd. This is intentionally less obscure and should help to clarify what the group is about and particularly to help colleagues in the University understand what we are about.

So to introduce our first speaker: Grainne has been invited along today because much of her current and past research looks at the kinds of issues Dai has talked about in his introduction

Keynote – Openness in a Digital Landscape. Professor Grainne Conole, University of Leicester. Abstract

I’m going to talk a little bit about the notion of openness which I’ve been working on at the Open University and more recently at University of Leicester where I’ve been since September. I’ll be talking about technologies trends. I’ll talk about learner experience. And I’ll talk about open practices – Wilma pointed out the hashtag for today (#elearninged) and how many of you tweet [it’s most of the room], that sort of thing is really changing what we do.  Then I’ll be a little more negative and talk about teacher practices and paradoxes. I’ll talk a littloe about new approaches to design. And then I’m going to talk about metaphors and the need for new ways and types of descriptions.

Technological Trends (http://learn231.wordpress.com/2011/10/25/trend-report-1). In the 2012 Horizon report we’ve seen mobiles and e-books highlights. In Leicester the Criminology masters programme have just given all of their students iPads as part of the package. We have Game-based learning and learning analytics – that latter is a sexy new term to explain the types of analytics we can gather on how people learn and use our materials, resources, tools. Gesture-based learning and the Internet of Things – there was a lovely article on the Guardian. See Also: Personalised learning, cloud computing, ubiquitous learning, BYOD (Bring Your Own Device), Digital content, and Flipped dynamics between student and teacher.

If you Google or look on YouTube Social Media Revolution and also The Machine is Us/Ing both of which really give a good sense of how things are changing. And you might also want to look at a report we did for the HEA where we looked at some key features of Web 2: Peer critiquing; User generated content; Networked – this is the power of tweeting; Open; Collective aggregation; Personalised. The report is: http://www.heacademy.ac.uk/assests/EvidenceNet/Conole_Alevizou+2012.pdf. If we had time

Gutenburg to Zuckerberg – John Naughton (blogs at http://memex.naughtons.org/) and it’s a great book. And he says: take the long view – we could never have predicted the impact of the internet even in 1990; the web if not the net; disruption is feature; ecologies not economies; complexity is the new reality; the network is now the computer; the web is evolving…

Sharpe, Beetham and De Freitas (2010) found that learners are immersed in technology; their learning approaches are task-orientated, experiential, just in time, cumulative, social; they have very personalised and very different digital learning environment. I have two daughters, one is very organised and very academic in her use of technology but she thinks Facebook is the work of the devil. The other daughter is dyslexic and is quite the opposite and loves Facebook. Who loves Facebook? Why? Who hates Facebook? Why? Our students will also be conflicted, have different views. And our students will be using both institutional technologies and outside tools

Open. Open Resources span a huge range – there has been huge funding for the OER spaces like MERLOT, MIT OpenCourseware, OU Learning Spaces etc. Increasingly research here shows that making OER available isn’t enough. In a recent report (http://www.oer-quality.org/) and the OPAL site we looked at what sort of support people need to use OER effectively, I really recommend the recommendations and that OPAL site if you are interested in OER.

Open Courses. These Massive Open Online Courses (MOOC) get huge numbers of participants but high drop out rate. Really interesting to have open educational materials and open courses (http://mooc.ca/). There is also the Open Access University in New Zealand.

Martin Weller, author of Digital Scholar and blogger, talks about open scholarship and exploiting the digital network, new forms of dissemination and communication. I use Twitter on a daily basis and am connected to about 4000 people there, the speed of disseminating information through Twitter is unprecidented and very core to my practice.

Thinking about Open Research I wanted to talk about some of the spaces I use. My blog, e4innovation, is core to what I do. Repositories have become a core part of what we all do – we have the REF coming up and those repositories are being scrutinised in more detail. And there is use of things like wikis and semantic wikis, bookmarking like Diigo, Slideshare, Dropbox, Academia.edu etc. Although I tend to use Twitter and Facebook mainly. I’m on Google+, Academia.edu etc. but don’t tend to use it.

Really interestingly Google now has a Citation tool within Scholar and you can set up a profile. And for sure these will be increasingly used for promotion, for REFs etc. This uses an algorithm from Physics I think. I applied to be a visiting lecturer recently and they asked what my h-index was.

Teacher practices and paradoxes – there are huge opportunities here but they are not neccassarily being fully exploited, we see replication of bad pedagoguey (electronic page turning for example). And intensive research universities like Edinburgh there is also a real tension between teaching and research because promotion is based on research not teaching practice and that pressurises time and attention.

So thinking about Learning Design we have been building up a series of principles. At Leicester we have Carpe Diem workshops on learning design and we’ve been combining this with some JISC work quite effective. Our 7 Cs are Conceptualise then… Capture, create, communicate, collaborate, consider. That’s an iterative cycle. And at the end of that you Consolidate.

In September we will be launching an MSc in LEarning Innovation using much of those learning design resources to think about how we approach this new MSc. So I’m going to share some of our slides and resources here. The Programme includes a series of “e-tivities”. We trialled this with a group of sessions with teachers in South Africa online over two weeks with 8 slots of 1.5 hr face to face sessions and additional work around this.

Peter Bullen and colleagues at the University of Hertfordshire has this concept of How to Ruin a Course – a great way to think about and improve a course. So we used linoit.com – a virtual sticky board – to think about what would and would not be included, what elements would be needed, and what would definitely not be in there. And then we colour coded for types of course content (eg communication and collaboration, content and activities, guidance and support, reflection and demonstration). And worked through this in Google docs, mapped this into a course map. And that has been pulled out into a plan for the course, technologies and expectations. The point about these different views is that they are designed to be iterative and improved over time. They may look simple but they are grounded in good and substantial imperical research.

We have also tried to reuse as much OERs as possible, to adapt others, and to create as needed. We’ve done a learning design resources audit to think through all that we need to deliver this course. We’ve built in various aspects, we decieded we wanted some podcasts, maybe a little interview or snippit of people like Diana Laurillad and at the OU we found students found these sorts of snippits really enjoyable and useful.

And then we’ve broken down the course activities into Assimilative, Information handling, Communicative, Productive, Experiential, and Adaptive activities. We have a little widget you can use here. And that gives us a picture of the type of profile of a course and lets you adapt it over time. This view can also be used quite significantly with students. I did an OU Spanish course and you get this amazing box labelled “Urgent: Educational Materials”. When I did OU Spanish my weakest area was communication by far. There is a really interesting link between what the course profile looks like and what the students need and take in.

As we started looking at the Learning Outcomes…. We didn’t do that first as you can get too stuck into the words here, easier to look at this later when you have a sense of what will be done. And then we can draw things together looking at how the Learning Outcomes and the Assessment (and all learning outcomes should be assessed) and how these are hit along the timeline of the course. So we mapped that conceptual model. And then we went back to linoit and set up a week by week outline where everything comes together. We can then drill down to a “task swimlane” and put into a little template for the e-tivities. And we are also drawing on some nice tools from the OU library in terms of information activities etc. And then finally we have an action plan for how we do this, a detailed thing to close the loop. These kinds of workshops can be very stimulating but you have to be able to follow up in a practical useful way.

And finally…

Metaphors. The ones I’ve been playing with are:

  • Ecologies – the co-evolution of tools and users, a very powerful metaphor; Niches colonisation of new habitats – Google+ perhaps; Survival of the fittest
  • Memes – particularly drawing on Blackmore here: something that spreads like wildfire on the internet, but perhaps we’ve gotten too cosy here
  • Spaces – campbell 72 talks about the cave, the campfire where we present, the mountain top, the watering hole – how might these apply in elearning
  • Rhizomes – the stem of a plant that sends out roots as it spreads… multiple interconnected and self-replicating and very like ideas and networking. Drawing on dave cormier here. Those of you on Twitter will recognise that sort of close furtive network of connections I thin.

The future of learning: technology immersed, complex and distributed… fuller notes on Slideshare: http://www.slideshare.net/GrainneConole/conole-edinb urgh.

Q&A

Q1) You talked about Learning outcomes need to be assed, can you talk more about assessment

A1) Assessment is fundamentally about articulating whether students have understood what we wan them to learn. I’m certain our old approaches are no longer appropriate. One of my daughters was

Q2) I was interested in your last slide about digital futures and was interested in whether you had looked at opening up coding practices

A2) I was involved in a project around x-ray chrystallography as Chemistry is my original background. Making raw data available we have questions of ethics and a very different way to share our ideas when still developing. But when I blog things openly I get feedback that improves the work. I think more open approaches particularly regarding data coding could be really interesting

Q3) What can be done to reduce the marginalisation of those not already using technologies?

A3) A lot of teachers do feel threatened, they are under a lot of pressure. I think this goes back to day 1 of lecturing in Chemistry. I was given a bunch of content and drew on my experience. I learned as I went and I think that’s how a lot of teachers start. I think we need to ease teachers into to easy conceptual tools that let them assess what technologies may or may not be useful – they don’t have to use everything, they can’t possibly know everything, it’s about baby steps.

And on to our next speaker…

Motivated, Omnipotent, Obligated, and Cheap: Participating in a MOOC (Massive Open Online Course) – Jeremy Knox, PhD candidate, School of Education. Abstract and Biography.

The research I will be talking about today is my PhD research on MOOCs which has been a participant observation pilot here based on three different MOOCs: Change 11, Change Education learning and technology – George Siemens, Stephen Downes and Dave Cormier; Udacity CS101 – Independent company created by Sebastian Thrun; MITx – first course offered by MITx.

MOOC stands for Massive Open Online Course. Udacity published 90,00+ enrollment numbers; MITx published 96,00+ enrollment numbers; Change11 has less, perhaps 1,300 active in the first three months based on my experience so far.

Open is perceived in the MOOC as both Open Access and Free. And for both Udacity and MITx that is what they do. That’s also why participant numbers are so hard to estimate for MOOCs – the door is open to entry but also to exit. Big gaps between enrollment and active participation. In the Change11 MOOC there is a more open curriculum and can decide their own outcomes and are encouraged to self-assess – a slightly different model.

Online tends to come down to either a central or distributed space. Udacity and MITx have central spaces where all the learning takes place – a little like an institutional VLE basically. So you have a central space with video lectures, notes etc. Again this is a point of difference with Change11 – all their content is created by participants rather than one organisation. So it is distributed across the web – blogs, twitter, etc.

Courses – MOOCs are structured courses. Udacity and MITx are very traditional with clear aims and objectives. Here you have to learn about building a search engine or about circuits and electronics. In Change11 students far more choose what they learn.

Hopefully that gives a sense of what a MOOC is, that there are various models in use here. So I want to talk about some terms I think might also define the MOOC.

Motivated – a central aspect of being a participant in the MOOC. Downes (2002) says that if you are not motivated then you’re not in the MOOC. There is an assumption of motivation and no central intent to encourage, support, motivate students. Perhaps an issue mappable to wider OER discussion. And some work by Downes found that as little as 4% of participants are active in the MOOC. Here I’m showing a viualisation of communication on Twiter between Change11 participants – you can see a small number of highly active participants/course members.

Omnipotent – is perhaps more relavant than open. They are sold as learners having lots of control over the learning process. They promote learner defined aims and self-assessment. That implies an innate ability to self-direct within the MOOC which we’ll come back to. Traditional education is framed as a passive process within this type of promotion. I suggest this isn’t just about Change11 which heavily promotes this way but also about MITx and Udacity the same need for self-directed students is assumed. The MOOC dissolves itself from responsibility for the students.

Obligated – Change11 requires students to aggregate, remix, repurpose and feeding forward. Participation is seen as essential in the MOOC. This is down to the model of the network that underpins connectivist theory and the MOOC. The more connected you are, the better the learning is. The network isn’t an analogy for learning, it is learning in connectivism. So as the network decreases so does the learning. So something to say there about collaboration. There is a tendency in the MOOC to enforce participation – important for the individual but also essential for the whole. So despite the idea of autonomy the network is crucial here.

So I think Omnipotent and Obligated are real clashing factors here… a problem for the MOOC.

Cheap – perhaps in the financial sense. But more in the sense of responsibility. Learners are responsible for own motivation, they must self-direct, in Change11 they have to decide outcomes and self-direct, if the learners don’t participate there is no course. There is a tendency for MOOCs to shift responsibility from the institution to the student.

So to finish… I would suggest that to rephrase Downes to “if you’re not motivated then it’s not my problem!”. Now I think there is an arguement for the institution or organisation to take that responsibility.

Q&A

Q1) I’ve participated in Change and I was a wee bit late contributing materials. I was excited to take part but it was rather demotivating as little was going on. Rather than Cheap perhaps Collaborative is more appropriate. Is that a better word than cheap?

A1) Yeah I think that’s part of it but I wanted to get at the fact that the institution should be involved. I think collaboration there would have to mean the institution also collaborating in the process.

Q2) Aren’t you trying to impose formal learning expectations onto an informal, lifelong learning space?

A2) I think I am questioning whether being able to self-direct is innate and whether this discourse of openness and access is actually right as these are not neccassarily innate things, that access to technology and understanding is not open, these are learned things.

Q3) I’ll come back to some of these issues but there is an interesting philosophical difference in France where courses were open and people can join and disappear. Perhaps this about opening opportunities for people to find out more and explore that learning but perhaps dropping out of these spaces isn’t a failure but a choice also.

A3) that is a fair point.

Wilma is now talking about the university of edinburgh’s innovative learning week which took place for the first time this year and our next speakers will be reflecting on that experience.

Case studies – Law less ordinary: reflections on Innovative Learning Week in the School of Law – Dr Gillian Black, School of Law.

I want to talk about one of our most successful ILW events. This was our Criminology photo competition organised by one of my colleagues who lectures on the criminology degree. She asked students to identify images from news, videogames, films etc. around crime and injustice. The challenge was to use the image and use text to change our expectations. This was set up on PebblePad and you needed to send in an image, text and the name of contributors. Students took images, shared them with commentary. And she also wanted this to be freely available and publicly available. You had to login to add images. But you could comment as you would on a blog. It ran from the beginning of January to he end of Innovative Learning Week. It was very popular.

I think the winning entry was an image on the idea of “Facebook Rape” or Frape. The success was such that Dr Suami is looking at running an exhibition of these images. And that reenforces that this didn’t just happen online but also was part of our offline practice as well.

Why did this work? Well Dr Suami is a very popular lecturer with enthusiastic students. And it was fun. But those of us who found it difficult to get students along in person perhaps will understand that an advantage of this activity was that students could take place at any time and on their own terms. I hope this will have a lasting legacy.

The other aspect here was that the activity did cross courses, engage colleagues, really brought the programmes together.

Followed by: Changing Atmospheres – The 1 Minute Film Project at the School of Geosciences. Dr Elizabeth Olson.

This project involved 5 academics designing this over two months. We set undergraduate geography students a challenge! We set them the task of recording audio and video separately and then making a one minute film about it. So there was a technology aim here. It was a two day challenge. We trained them the basics of filmmaking – a good shot, storyboarding, artistic outputs, sound recording. Sent them out for 5 minutes to capture stuff. Then we had a full day for capture. We borrowed tools – H1 and H3 zoom mics, HD camcorders that the department has for research. We used Mac Pro and PCs – brought in some extra kit of our own into a lockable room. We ended up using Audition (free software) for audio, And some of our free tools we used what software we had so Adobe Premier CS5 and Final Cut Pro – we didn’t have to induct them in any of the software really.

Feedback we had was really interesting – the storytelling aspect complimented everyday practice. A worrying comment that this was the most useful 2 days of the year! And another found it invaluable as an opportunity to explore the city as good geographers from a very different angle. We let students vote on the films so I’ll show them from least to most voted on films. [great wee films although speeded up scenes seem particularly popular]

We had increadibly popular feedback, a lot of students want to carry on filmmaking as a hobby, and students have talked about using film and photography into their assessed work. It was increadibly labour intensive, increadibly good fun.

After a short tea break we are back for some case studies which are just being introduced by Marshall Dozier

Case study – 2012: A MATLAB® Odyssey – Antonis Giannopoulos, School of Engineering. Abstract

Really I should have Dr Craig Warren, my former PhD student, as author, it’s all his work but he is on holiday at the moment!

So I will be talking about turning a traditional lecture based course into a largely online course. But lets start with what MATLAB is, how we used to teach it, why it needed to change, the aims of the new course, what new material was creates, what tools we used and some feedback.

So MATLAB is a programming environment for algorithm development, data analysis, visualisation and numerical computation. But it’s about problem solving, they don’t come in to learn programming for it’s own sake. We teach some sort of programming, usually in second year, in Chemical, Civil, Electrical and Mechanical engineering – we all arrived at MATLAB separately but as we were all teaching the same thing we though that we could really do something here to bring our teaching toether in some way.

We were teaching MATLAB through lectures and some computer lab-based exercises. If you aren’t a programmer or don’t like programming these lectures can be really hard to engage with. We can have live examples, movies etc. but it’s not hugely effective. Those lectures were ok but not very exciting. We wanted to change this a software tool you really only learn and learn through programming tend to learn through doing something as a hands on experience. So we saw this as an opportunity to really create engaging interactive material. We created a 5 credit module and use this as part of other modules. We wanted it to be online, self-paced, self-study model. Pass the buck to the students to take responsibility for working through the materials. It was very much targetted to those with no prior knowledge of MATLAB or with no previous programming experience. And we wanted them to learn to be competent using the most common features of MATLAB to solve engineering problems.

The tools we used were screencasts created with ScreenFlor and also a Samson Go Mic. And we have online course PDF assembled from LaTeX source – LaTeX is old tech but lets you output your material to all sorts of different formats.

The new material created includes a core comprehensive PDF with link sto lots of supporting material; self-test excercises; tightly intergrated screencasts linked from PDF – showing and describing basic MATLAB concepts and providing solutions to exercises.

You can have a look at the site here: http://www.eng.ed.ac.uk/teaching/courses/matlab

And I’ll give you a demo here of a screencast.

This course is being used in all of the different 2 year undergraduate courses across engineering. They develop numerical and programming skills and are being used really well. We have the courses as self-paced materials but they are well supported – my course we have 10 x 2 hour labs to work through problems etc.

Student feedback has been really good. We intentionally limited screen cast to 5 mins maximum so you go and do and practice as you work through the course. The course is available outwith the university. The screencasts are on YouTube. They’ve been live for 2 years so we’re starting to be able to analyse usage. We plan to publicise the course within UoE. And we want to use this course to develop similar material for other software tools that are part of degree programmes in engineering. And we want to look at other ways to make core materials available in more interactive ways – maybe with tools like iBooks for instance.

Acknoweledgement here must be given to the Edinburgh Fund Small Project Grant which helped fund this work, to Dr Craig Warren of course, to colleagues across Engineering and LTSTS for their support.

Q&A

Q1) You mentioned that MATLAB was really expensive and I was just wondering whether students have access to that software away from the lab as that can be really important for learners on self-paced courses.

A1) So the student version of MATLAB is available on all university machines across all labs etc. But students can also access MATLAB remotely via nx. It’s not as easy as it could be but they do have access whenever they need.

Q2) Any plans for transcripts for deaf students. And I think you could be making the course inaccessible to those students with those videos. And transcripts may help foreign language students.

A2) I haven’t thought about that particularly. I think that

Q3) You talked about analysing use -how are you looking at this and are you starting to look at student performance

A3) Craig is starting to do this. We have seen far better performance on final exams. But we need to do more.
Case study – Maps mashups as a teaching aid. Richard Rodger, HCA

I’m going to be talking about the AHRC funded Visualising Urban Geographies project. And I want you to imagine yourself as geographically challenged students here. We are great at the cultural aspect of history but I think we need to do far far more with geospatial perspectives on history.

Our objectives were to create a set of geo-referenced historical maps of Edinburgh, to reach a broader public, to develop open source software and avoid GIS…

And the contributions of my colleague Stuart Nichol and the staff at the National Library of Scotland’s Map Rooms – which is a fantastic resource – has been crucial here.

So we started with resource development. Maps were scanned and geo-referenced. One of the core issues to address was the thorny issues of boundaries and we wanted to make multiple types of boundaries available for all of these maps.

So maps have lots of historical information of course. I want to give you a few examples here. So looking at Edgar’s 1765 map we’ve given this topography – Edinburgh is certainly not flat! These maps have huge detail – looking at Edgar 1765 – so pick out something here, West Bow and Victoria Street perhaps, and I’ll show how this changes through 100 years of maps here. You can trace changes on the map and relate it to other documentary material and resources.

And then of course there is the chronological map – Chris Fleet of NLS is very proud of this form here, the map started in 1870 and gradually it grows to show the expansion and changes to the city over time, giving a 2D map a more dynamic feel that will appeal to a more general audience and their spatial awareness.

It’s probably evident here that our data is held in all sorts of different places… The Mapbuilder is all about address based history – census data, taxation records etc. So we used a geocoder to exploit these address based history. And we were plotting these points on a historical map – anyone can plot on a google map but it’s adding it to the historical map that adds important value here. So you can look, for instance, at clustering of addresses of solicitors in Edinburgh. When addresses have been geocoded they can be exported as a KML and viewed on a historical map. So the distribution of edinburgh solitors from 1861 superimposed on a relevant historical map. If we look at the same sort of group of solitors from 1811 we can see a move of location – that needs investigation. I think that’s very much about the change in practice in the law around this time, from lower new town to more central commercial areas.

Other ways to make this sort of data available to the wider public. So looking at James Colville, the Edinburgh Cooperative Building Company Ltd, the colonies and his walk to work in the 1870s – looking at this data you can see real social change over time.

Similarly you can look at James Steel, 1869 – Easter Dalry feu – and see the development of Haymarket over time.

Another tool we have here allows you to measure distance from the tool, you can see the trip of Colville’s walk around the colonies – the distance, the gradiant, the area of his travels. Very useful.

Of course addresses are one thing but also wanted to think about properties in Edinburgh. So boundaries and juristictions are very important here. So we’ve used our own data on properties here. One of the greatest contributions I think is in the definition of these maps – by creating shapefiles for these maps we can pour data into our thematic mapping engine. We can use those boundaries to express complexity in administration areas of the city. You have to imagine a mosaic of overlapping juristictions and some areas that are entirely dislocated from the rest of the city. For a historian to have that laid out so you can then plot data into those maps with the appropriate boundaries. Whilst we did it for Edinburgh it could be for any city really.

Q&A

Q1) How have students been finding these tools and what have they been doing with them?

A1) History in practice. Dissertations and advanced projects. 8 different types of case studies of that. Possibly talking to the converted here but they have responded really positively. And there is a community neighbourhood project in Wester Hailes that has found this work really useful and there has been lots of community engagement here. And there is also a project on mill sites in Perthshire that have also been using this data.

Case study – ‘Engage & Reveal’ project – Lindy Richardson, ECA

I’m going to talk to you about collaboration. The title should be “Reveal & Engage”. But after listening to everyone today I’m going to rename it “Engage, Reveal & Engage”. One of the challenges we have is about engaging our students. We artists can be quite separate in our practice until it comes to showing off – much of how artists use the web is about showing off our work!

So I want to start by talking about collaboration, working together to achieve something. Artists do get together whether virtually or in the flesh. There are loads of collaborative drawing projects line the Moly_x:an international moleskin sketchbook exchange – you can find this on Flickr. Artists draw and send on and new material is added. It’s a progressive linear collaboration. You contribute and it is physically exchanged and posted on the web. You haven’t actually interacted with the other artists though. It’s actually quite remote.

I set up a project in ECA to help students to understand how to physically interact with others’ work. Student one had two areas of pattern, student two had two different areas of patterns. And the idea was that they printed onto the print bed. Then for the second screen you had to print on the person before you’s work. They freaked out! The idea was about physically interacting and engaging with their fellow students’ work. We do lots of physical stuff in art which allows lots of handing on of work rather than collaboration – but you wouldn’t do that with one person researching something, another writing an essay, etc. So the idea here was that they engaged with and reflected on the process but still students in the printing project were mainly thinking separately…

So, I then set up an international collaboration project. This was British Council funded across cultures encourages collaboration through physical exchanges of materials from indigenous cultures. So we showed students Ayreshire needlework and Paisley paislies. Students responded to that original inspiration. And partner students in China did similarly, took inspiration and sent to us. And then the idea was to exchange these fabric pieces and we would add or subtract to these as part of the exchange. And what I expected was absolutely not what we got! So we sent a beautiful hand embroidered pieces and many of thenm came back quite crunchy, quite glued. Some of our students were quite upset by that.

So… Reveal and Engage… was a project at ECA to encourage our students to work together and to move out of their bubble, and to find synergies and common research areas. So we wanted them to contact each other, to engage in dialogue and to be collaborative. As artists and designers when we put up our materials online that’s our name, our work, and some text. So we did this event in the sculpture court. Each student got a 1.5 metre square space to pitch themselves. We taped out squares, they could pick their own area and sell themselves. You were speeddating each others work basically. Interestingly a few programme directors said no to this event. But when the event ran the students kept coming up and wanting to join in. I was a bit naughty and let them take cards and engage but not pitch themselves.

So the students required to provide a concise statement about your areas of interest and research focus. And examples of their own practice. It was really good for the students to think about that. So the students had a name plate with name, email, mobile number, website (where appropriate) and programme. In the second year we were asked for name badges though one student hated that. The students had to make 5 contacts. This was excruciating for some of them. It’s so easy to do this by phone, email. etc. To force them to do this physically was alien but was really really helpful. They had to make a minimu of 5 follow up meetings for discussion and potential development. Some were nervous about having too little interest, others were overwhelmed. Students quickly became aware of how effective and relevant their approaches were.

One of the most important things was to encourage students to enjoy the experience. to make contacts outside your area. And it will have huge benefits in the future. So here is an image of an ECA fashion show where students from textiles and fashions have worked together.

And then… ?

The challenges of working together became apparent. We set up staff surgery sessions to help with this and this also allowed you to work with both students at the same time, staff from outside your own areas. And that helped a lot as you can set up “collaborations” but as staff we often leave students to it and they need some of that support to make that work.

Some great collaborations took place – lots of fashion and textiles students working together, a great example of a performance costume and jewellery designer coming together. And the students really became aware of transferrable skills, particularly around communication, presenting themselves, being professional.

So how is the collaboration and the success of this venture assessed? We use the e.portal – we give feedback and the students have to also reflect on themselves and only then do they see both aspects of feedback in parallel, we use peer assessment, we had some sessions with the students themselves. But there are challenges here. Our students are very visual but they are not as keen to put their work into writing so this means we can have great projects and work from students but then their poorer performance on written aspects and reflection can effect their feedback or performance.

Next a project with concrete, glass and textiles in collaboration with Saint Peter and his collaborator as muse [I’m pretty sure that’s wrong, correction to come], an incredible concrete thing. And we will produce something amazing marking collaborative forward direction with the University which ECA is now part of.

And now, to lunch!

‘Enhancing the student experience- Representing, supporting and engaging with our 20,000 members’ – Rachel King, Martin Gribbon and Andew Burnie, Paul Horrocks (in absentia), EUSA. Abstract

Through this session we hope to give an overview of EUSA’s activities and to give an idea of the practices and activities that IT tools have been used in our work. We had hoped that Paul Horrocks, a third year maths student whose work you will see, would be able to speak today but he’s tied up with exams at the moment but we wanted to acknowledge him here.

Our visiiojn is to represent the student voice effectively to the university and beyond, to support student academic and social wellbeing, provide opportunities for participation and development through student activities, and things like discounted food and drink etc. We like to be a collaegue, a critical friend etc. to the University. All students of the University are automatically EUSA members unless they choose to opt out.

Representation is really important, we have to show we are listening and responding and to know how best to support students. Our general meetings have had poor attendance in the past, often not quorate in fact, so we have, for the first time, run a referendum online this year. And we had an average of 2000 votes on each item versus meetings that would have perhaps had 120 students so that’s been a success we think. We do also try to encourage students to engage – we can seem like a strange and perhaps irrelevant interruption in studies. So we do things like supporting candidates for the student elections and telling them lots of tips and hints about how to run a successful campaign… [we are now watching a video made for candidates on how to deal with nice and very difficult students you are trying to engage with – on YouTube as Election Advice – Door Knocking; Election Advice – Lecture Announcements].

Representation is most effective when student led so I am handing over to Andrew to talk about a very successful online petition that he led…

So last year registry informed us that they planned to reduce the month of exam schedules down to two weeks, were really angry and upset as that crammed near 10 exams into a very short period. I am lucky, I’m a representative for my class so I could email student colleagues and to let the university know. We were able to get it increased back to a three week period. But that wasn’t great. Many students hadn’t heard about this until my email, they didn’t feel informed or consulted by the University. So I set up an online petition – I wanted name, I wanted to know about course and school to see if this was just an issue for me and my colleagues. Then I wrote some code to turn the responses into a spreadsheet and look at the statistics. I thought that we would have loads of Science and Engineering responses but we actually had loads from HSS. And we had good responses from first and second year students. The most responses were from Informatics, not surprising as my school and they personally had an email from me. And I got a lot of students on joint degrees commenting as they felt that their dual schedules were not properly accomodated. I also had Google Analytics on the site to see activity. I shared the comments that had been placed. Those pages were used quite frequently and students were really thinking about whether to sign it. It was first just promoted on Facebook by me and by emails to my school. On the third day I send EUSA an email asking for it to go to class reps. When you target emails at engaged people like class reps. And it went pretty viral on Facebook. So we saw lots more responses. And Twitter was useful too but not many. Most students use Facebook, a lot don’t use Twitter – but computer scientists do. So, we had all these responses and, with EUSA’s support, we got the decision reversed by Registry. So why was it successful? It was student led and that’s crucial. Well it was a petition about only one issue, it was focused and clear, but you could personalise it with the comments box. People could participate in different ways – by signing the petition, by sharing on Facebook or even coming to the meeting with Registry, allowing that engagement on lots of levels was really important. Back to Rachel…

One of the other things we do in supporting our members is the services like the Advice place – we offer accomodation, health, etc. advice and that’s all online now. And we have been working on outreach with a roadshow around the university campuses to explain what the Advice Place is and does. And part of that is ensuring their Facebook Page and Twitter pages are up to date. The Advice Place is now in the Dome with a lovely new centre. You can see that they are sharing information on Twitter about student support funds, condom deliveries, where to find them, etc.

Societies are a really big part of students lives here, there are over 160 and we have been setting up a database of all societies so we can train treasurers etc. And you can now engage online, join online, pay your subs online etc. Each society has a page they can update and let people know what they’re doing.

We also have a volunteering centre in the Potterrow dome now and students can come in or look online for volunteering opportunities. The volunteering centre can easily add opportunities and students can easily sign up. I really encourage you to take a look and think about volunteering opportunities you may have – there is almost no part of the university that wouldn’t benefit from some volunteering effort.

We also have various peer support services – there is an International Buddy Project, and a project called Tandem – for people who want to practice speaking various languages, just talking not academic stuff, and that’s open to staff and students. We also have a scheme called Peer Proofreading and it followed a pilot in recognition of demand among non-native English speaking students for reliable sources of help in proofreading student work. The proofreading is purely about spelling and typos, not about academic content. So the student submits some work, it gets sent to a trained volunteer proof reader, and they send back feedback and the student can meet to discuss issues etc. And there is a community of proofreaders building up – a Facebook group for them, we’ve been surprised about how many students were keen to train as proofreaders actually.

And we have an initiative called Path Finder which is about choosing appropriate classes. At the moment students have the DRPS only, it’s hard to navigate that system. And it also helps highlight prerequisites etc. The idea is that students and staff have coauthored course descriptions. Students can see both sets of information and can see the consequences of that course in terms of course eligibility etc.

So far they have the DRPS data and BOXE reports and we hope that Paul, who has been designing this, will be able to work on this over the summer and will be able to get some financial report to do this. And now over to Martin…

I’m going to talk about a Facebook page we set up for Freshers Week. I don’t think this is neccassarily groundbreaking but I wanted to explain why we used that approach.

This was a Facebook Group, called Edinburgh University Freshers Week 2011. It has 2131 members. The first post by a student was on 17th June 2011 and actually we had 1000 members already at 17th July 2011. Students really want to engage early in the year.

So why do this? Well students want to come together before September. It allows students to ask questions they might otherwise keep to themselves or each try to ask individually. So it allows students to share experiences and expertise. However a downside there is that not all answers will be correct so we have to keep an eye and comment where there is an incorrect answer address that. We use social media a lot but this is by far the most successful social media activity we’ve done, it’s really enhanced the student experience.

So to look at Facebook here you’ll see a typical question which was about whether or not accommodation services should have been in touch, it gets 26 replies and they find solutions and approaches. And we have another student looking for others on his course. And others share where they will be, finding out who will be in your halls etc. You also see students setting up their own groups for various accommodation spaces etc.

We have set up the Edinburgh University Freshers Week  2012 group already. They have to ask to join. I’ll accept them only if they are real people. Businesses we decline. But we’d encourage any staff who want to to join this group and help students feel part of the University. Back to Rachel…

Future challenges for us certainly relate to engaging with our ever-growing and diverse student body, and ensuring there are inclusive and accessible learning and teaching – podcasts and WebCT being of concern at the moment.

Q&A

Q1) Are you thinking about having any special focus on distance students as we increasingly have more of these

A1) Rachel: We are talking with the University about this. There is alo an independent group called SPARKS that support student associations who are also looking at issues around distance students and how to support them so we are engaging.

A1) Martin: Obviously Facebook and Twitter etc. are globally available. We do also email about events on campus and campaign etc. to all students, distance or not.

Q2) DRPS is not only difficult for students, also very difficult for staff too. The Pathfinder system looks great but how do you plan to keep information current?

A2) One of the things that Paul has been so grateful is that the school felt that to set this up they needed the ability to maintain and keep this system up to date. And there would be a student coordinator every year and to add new data every year.

Q3) Are there plans to roll out Pathfinder to other schools?

A3) They would very much like to. They have tried to design it so that that’s possible.

Case Study – ‘The Idiots Guide to Collaborative work practises: Author, The students’ – Victoria Dishon, School of Engineering

I’ve been doing some work with our students on how they engage with their academic studies using technology. When I started doing that there were significant discussions in our school about what students do when they receive an assignment from us. I didn’t say what sort of technology I was looking at. I just asked students about technology.

Someone from another organisation said that “Engineering does a lot of group work, do you provide collaborative software? What do the students do when you give them an assignment?” and although I had some ideas I wasn’t actually sure.

So to see why we do so much group work we needed to look at our degree programmes. And all of these are accredited b the relevant professional body (e.g. Institute of Mechanical Engineers) and as a result the activities and assessment is very structured. So I’ll show you our mapping of specific learning outcomes to the degree programme from when we were most recently accredited in 2008. So if we have a look at these learning outcomes the ways in which these are phrased clearly requires you to talk to others, to exchange knowledge. And there is a requirement to manage and participate in shared experiences, in group experiences.And that is experience that you need to have for the real engineering world. And you need to understand customer relationships and peer collaboration.

So, I decided, going back to that original question, that I needed to speak to my colleagues about this and ask them that question. And my colleagues said: well it’s difficult to say; it depends on the assignment; I don’t really care as long as it comes in on time; well they must talk and meet. Some of my colleagues know really well what their students do. And it does depend on how much they are involved with a specific assignment. But generally it wasn’t really clear.

So I thought did I ask the right question? Did I ask the right people? So I decided that I better ask the students… So normally if you send out a student survey you will get 10-20 responses from super keen people. But I got 200 responses!

So I asked if they were using social media or file sharing sites for a class activity or an assignment. 94.5% said yes. I asked about what they were doing with them. There were tick boxes etc. and also loads of comments. I’m happy to share the detailed data here and will be doing that with my school of course. Students were using social media to discuss how they use class materials. Students upload tutorial sheets to Dropbox or Facebook and working their way through the tutorials. They write their workings out, take a picture, share it, correct each others work, explaining what they’ve done wrong. etc.

Students responded that they do this all the time, it’s not part of their assignments alone, it’s a core part of what they do. They do a lot of filesharing – for varying reasons. Mainly they do that because email isnt very efficient and don’t want stuff lost in the email boxes. And they are creating shared materials, not just assignments. So they had more in their toolbox than we thought. Not hugely surprising but the data is super helpful. We have decided we want to explore this more. I originally sent this survey to all our students. I followed up the survey asking if students wanted to come and chat and follow up on this. Seven students came to chat for half an hour, most went on for an hour and half in the end. All of those students were happy to work with the school to develop tools to help them with their learning. But that was a very self-selecting groups.

So some examples…

A 1st year Civil Engineering student has a laptop and smartphone. They are part of her life – not just her studies. She uses facebook every day mainly for social activity and she uses it as a lifeline to back home in Aberdeen. And that link was really important to making her feel her at home at university. She is also happy to join in work on there. There is a year 1 Civil Engineering FB group – they gossip, they share class info etc. Its set up by students themselves. She did join in a FB group for sharing documents and discussing an assignment. After that completed that group stopped. She uses dropbox as more reliable and harder to lose than a USB stick, She uses text messages to arrange personal and academic meetings. Not a big fan of email – it doesn’t seem personal enough for her. She’d prefer phone or Facebook.

A 3rd year Electrical and Mechanical Engineering student is a class rep and uses technology across personal and academic life. He use doodle to arrange meetings with email confirmations. He uses Dropbox to manage all files and to co-create academic materials. He doesn’t use his school file space at all. He also uses Dropbox to upload tutorial questions and past exam questions. And they use mobile phone or iPad camera to share notes etc – that was much more widespread than I realised. He regularly creates and managed FB groups, managing a University of Edinburgh Society page including advertising. And he uses FB to plug gaps in the knowledge between his two disciplines that are not fille sby the academic materials.

A 4th year Electrical and Informatics student. He considers himself to be completely digital, uses a laptop and mobile. He sees everything online as his front space to the world, that it is his personal brand, and how important he thinks that is. He uses Google docs, dropbox etc. And he’s created loads of spaces himself here.

So the commonalities here…

  • Ease of use
  • frequency of access – want everything when they need it and where they are
  • consideration of the tools that met the differing academic and social requirements
  • all demonstrated levels of understanding of privacy and security issues that suggested these had been considered before I spoke to them
  • all consider these tools to be essential to their acadenmic work set
  • the development of these strategies happen mostly without UoE staff directio or guidance, through peer discussion adn actions.
So… what do they do when we give them an assignement? They go out into the world and gather their digital office tools, on a bus, at the flat, in the library or in the computing labs,. They work together, they work separtely and they share. And they do a great job of this without us
Q&A
Q1) This sounds very positive but are there students who fall off the edge here..
A1) We had a real mixed set of responses. Some students were struggling and didn’t want technology forced on them. One of the students – the one that created the 3rd year mech eng FB group. There were 102 students in that coure, and 98 were in the group and the four students were being sent that material separately to keep them up to date.
Q2)
A2) We try to provide flexible students who have the knowledge to go out and find the materials needed for any task – whether an assignment or any other challenge. We are saying to them here is the way to identify the problem, find the right tools and find the solution. So it’s about giving them the skills and toolsets to address any number of issues.
Q3) By the time you’ve reacted to what students say they want they will have moved on… or by formalising that space they will move on because they don’t want you there surveilling.
A3) I would quite like to have shown you the FB groups students use so I asked for permission but they said no. It’s their space. If they want us to help they will ask that, or many will. My concern is about those who are not confident to do that. But us going into their spaces is an issue, it would put them off. It does raise real questions of how you support technology and what technology you support.
And after a short tea break it’s onto the next session…

Case study – Digital Feedback – Dr Jo-Anne Murray, CMVM Abstract

I’m going to talk about some work we’ve been doing out at the Vet School. Some of our students are engaged in online distance education courses so when I talk about digital feedback I’m talking about distance students in particular.

Interaction and communication is key to engaging students in online learning. This is really important when you look at the literature. So it’s about building a community learning experience. So we provide virtual lectures that can be accessed asynchronously. We have a virtual classroom that allows realtime interaction between students and the instructor. We also have text based syncronous discussion. And we have our own virtual campus in Second Life for students and interactions between students and instructors.

So we do provide an aspect of ongoing feedback. But when we come to assignment feedback this has typically been text based and has been delivered by email or through the VLE. Feedback enhances learning. Hand-written comments can be given weeks after submission. And when we think about students perspectives of feedback and the National Student Survey our students are not all that satisfied with the feedback particularly the timliness of feedback, the level of detail and the comprehension of that feedback.

We have lots of work on feedback for traditional students but there has been pretty limited work on the role feedback plays in distance education. Most studies have only examine text-based feedback. And can be limited due to lack of verbal and non-verbal information. Two important factors here are social presence and the sense of instructor interaction, things like friendliness, humour, ways to let the student know that the instructor is concerned and interested.

So thinking about digital technologies… we could use audio, screencasting, webcams. Although quite limited there are some programmes using digital feedback in HE. And this potentially gives us an opportunity to provide richer more detailed feedback, more comprehensive feedback, more timely feedback (but not taking more time to produce), nuances conveyed through tone of voice and use of learning. So hopefully enhancing the relevance and immediacy and usefulness of feedback.

So our case study here relates tio the MSc/Dip/Cert in Equine Science. This is delivered part time over 3 years. And it is delivered using a blend of online learning methods, through asynchronous and synchronous discussion. Students enjoy and thrive on quality unteractions and we really try to promote a sense of presence in the teaching. But feedback on assignments lacked that.

So we trialled feedback on dissertation proposal assignment. We used screencasting software called Jing to deliver this digital feedback – it’s a free to download software, it’s easy to use and it’s less time consuming than generic feedback sheets. So if I play you an example here you can talk through the feedback but also highlight relevant text and the key areas being discussed.

We asked students for feedback. All of the students reported digital feedback as helpful and preferable to written feedback. Felt it much more personal and helpful. Some also found seeing the text being discussed particularly helpful. In terms of improving the students work many of our students felt that it did improve their understanding of how to improve their work. All students said they would like this type of feedback again. Most found it was easy to access, we supported those who had more difficulties.

In terms of tutor feedback and how I found it it was very easy to use, it felt more personal to each student, probably included more detail – I was able to explain to a student how to improve her work far easier through talking than through writing it down. And less time consuming.

In conclusion I would say it’s a very valuable tool for providing feedback. It was a very positive experience for both tutor and students. And it really enhanced the quality and timeliness of feedback.

Q&A

Q1) You used JING, I suspect that it was stored to their own server… so who has that recording. Are there any issues with that?

A1) You have to watch out how you upload the recording to the servers but you can make it private to a specific URL. I have downloaded those files to our own servers as flash files so they could be deleted if we wanted them to be.

OER, OCW, MOOCs and beyond: open educational practice European research & Discussion – Professor Jeff Haywood,Vice Principal Knowledge Management and Chief Information Officer.

What I’m going to cover is to quickly look through OER, Open CourseWare, MOOCs etc. and educational practice, and to speak about what we do and don’t do here at the University of Edinburgh. And to end on a set of slides on economics.

If you want to read the best text on this it’s Taylor Walsh’s Unlocking the Gates (available free from Ithaca). So OER or Open Educational Resources… it is an area of real interest to those that are in th eeducation for development and developing nations etc. so organisations like UNESCO etc. have funded these. And funding from HEA, JISC, Jorum etc. have been important to the creation of OERs. And people like Open Nottingham and Leicester for instance have really stepped into this. We have tried before and may want to revisit.

What is OpenCourseWare is kind of a hodge podge of resources, many of incomplete. MITs set are rated quite highly but many of the resources that are referenced are not open, you cannot do the readings here. There are standards coming through here… there is development of ISO standards takiing place. And the Open University is one of those who have stepped into this domain and into free courses and the space of the MOOC. The thing to note here is the idea of fully automated courses. Standford’s first course here was CS 101 and if you see their FAQs you are entirely walled out of the institution and you get no credits for the course. MITx awards you a certificate but not tradable in the academic exchange sense. And ChangeMOOC which is about the converted learning with the converted.

I also wanted to talk about Coursera which is a Stanford spin off. There is a question here for Edinburgh… do we build our own. For us we think it makes sense to join in with an existing leader so we are talking with Stanford adn Coursera to open that up and looking for volunteers to build materials for that space.

And I wanted to move on to OEP – Open Educational Practices. The OPAL website (oer-quality.org) and this is about thinking about what you might do and what you might need. In terms of structure and need you will find some super thought provoking discussion in the documentation there. There is a classification scheme with a Low to High Learning Architecture scale and an OER Usage scales rom Low to High. So for an institution you can conciously think about conciously where you may want to be on that spectrum.

The OER University – also mentioned earlier – one of the crucial things here is that it is going to be cheaper for the learner – there is a note there for cheaper rates for assessment and credit. So it has the model of learners learning from OER, supported by volunteers, then open assessment from participating institutions, then grant credit for courses, and students are awarded diplomas or degrees [Jeff is showing a diagram adapted from Taylor 2007]. So we are seeing some decoupling of the institution here…

So I have been working on a project, OERtest, with Hamish McLeod, Sue Rigby and others, looking at how one can go about testing knowledge from OERs. And the guidelines we’ve been building up are concerned with entire course-modules offered as OER – the OER must be an entire course unit/module with full course materials, LOs, guides, assessment protocols, supporting documentation, equivelent to a unit/module offered in any HEI. It is intended for units which have been made available entirely online in one space. So it’s perhaps more like a MOOC.

We have several scenarios here. One is an OER traditional student who attends our institution, studies OER modules, request assessements, then use credits within the same institution. Many were nervous about that but seemed like the most straightforward idea.

The next scenario is an OER Erasmus which is the notion of a student completing a course from another university that is used at home institution – a Stanford CS module say as part of an Edinburgh programme.

Another scenario is an OER RPL is not a student at all, studies OER module from… whereever. And requests assessment from our university and uses credits from our university. This is very much like recognition of prior learning. It should work with relatively flexible institutions. But if you look across Europe some organisations regulate that sort of possibility and process and indeed regulate the cost for those sorts of work.

So the critical bit is you have to understand where in the qualification framework you will define yourself as an institution. You decide the level you want to work in. And how many credits you will assign to the work to be done. And then associated with that when you issue the marks you have to tell the people who are receiving those credits how the credits are acquired. And all of the students that graduate have a certificate explaining how the teaching took place.

So…. we took the proposal about teh University offering credits for other learning to the Senatus Academicus and actually they were quite unphased, as an institution we have real confidence in our ability to ensure that the right process takes place to ensure that we this properly if we decide to do it.

Economic Models..

OER

  • cost for HEI is the sum  of value of all inputs needed to design, develop, maintain course materials and delivery platform plus ensure visible.
  • return on investment – reputation, increased applications, signals quality, pro bono service, complies with current ethos
  • Cost for learner – not a lot of evidance that suggests that the value to the learner community is significant. Time to use, need to integrate into other learning.
  • ROI for learner – additional learning materials for course or pleasure. There is some evidence that users of OER are already students looking for additional materials.

OCW…

MOOC

Cost for HEI: again as per OER plus lite-touch tutoring/support and lite-assessment mechanism for certifiate (if offered) and “advertising” and keep pushing these courses.

ROI for HEI – all of the above but stronger, arena to “practice” OEP – and that’s a place to play that is separate from your main institutional practice

Cost for learner – as OCW but more structured/demanding – and that can mean more drop offs/out

ROI for learner – closer to the “educational real thing”, possible “proof” of competence as certificate – not a trivial thing in some parts of the world, It will cost you ££s for your certificate but that proof of competance is fairly inexpensive and may be well worth that investment.

So… ROIs on accreditation of OER-based learning (=MOOC+Assessment+Accreditation)

The Cost for HEI:

IF (unbundled curriculum = 0)

ELSE (course materials/tutoring = MOOC)

+ full assessment for credit + ward)

ROI for HEI = as MOOC + ££s for assessment/accreditation

Cost for learner = time, ££s

ROI for leaner = accreditation, certification and the pleasure of learning.

So… the cost implications of OER-based learning… Well…

  • Level 9 UoE course = 120/6 = 20 credits @ £9000/6 = £1500 if taken “normally”
  • Cost to assess learning achieved = 1 day work – £300/£600 (gross salary/fEc)
  • Cost to validate/award = 1 day work = £300/£600
  • Cost to learner for 20 credits = £600/£1200

So cost only low versus normal course. So if we want this to be cheaper then the assessment must be lighter, must be different from normal assessment. So needs to be lighter and automated. Which is great for competance based courses, not so much for qualitative courses.

And finally… we know what it costs to do it… what are we going to chage for it. The price can be set for any number of reasons…what can the market bear – which is important for most of our courses and why the business school charges twice as much and dentists can charge even more. And then there is the impact on current offerings of price differntials, small or large. Impact on reputation for quality. Loss-leader approach? Purposeful cross-subsidy for pro bono services etc…  How do you position your institution?

Conclusions – well there are spaces that you can experiment and play with in th ewider educational ecologies for traditional universities. Change in education has been slow, perhaps leading to complacency, or at least low agility. Awareness of why one is there is important for reputation and sustainability. There really is no such thing as a free lunch both for universities and learners.

Q&A

Q1) I don’t think I agree that the crunchy bit of the issue is the economic issue, I’m concerned that the MOOC movement isn’t going back to 1990s style automated learning and isn’t very pedagogically interesting.

A1) I agree to an extent if we’re talking about what MOOCs have largely done to date… a lot have come from computer science and engineering type disciplines where there are competencies that can be assessed in more automated ways. But you need to get the learning outcomes and credits right here and a trade off between the types of course you run in these spaces versus in person courses.

Q2) My issue is about what kind of learner we have in mind. Getting into the university has a bunch of pre-requistites, that’s partly about fairness of admission, partly to make sure students are able to complete and succeed in a course. If you create a course that anyone can take we might as well just open our doors.. that’s one of the implications I think. Isn’t there another or better way to tackle disadvantage of access. Should we provide a bridging process.

A2) I think those are legitimate concerns. But it depends on how you view entries to a MOOC. Participants only get assessment at the end of the programme, that’s one part of the answer, and the other is that this model is predicated on crowd-sourcing the answers to your questions. We shouldn’t assume we have to have the answers to everything. Maybe answers will come from knowledgeable others. Perhaps you moderate them, But it’s not your responsibility as an institution. It’s a different mindset to the one behind our closed gates.

Q2) So how do you manage those expectations?

A2) Well the key thing is it’s a different experience I’m talking about here.

And finally…

Dr Jessie Lee is closing the day for us with thank yous to the speakers, to the committee who have put today together, and information services and the Institute for Academic Development, and lets thank everyone who came along today as well.

And with that we are done here… lots of interesting stuff today and lots of thoughts and ideas to follow up on.

 

Delicious Share/Bookmark