Core Activity 7.3 Approaches to assessment in my setting

The background research on this subject highlighted a number of aspects of assessment that I want to incorporate in my practice.

 

In the PLOT webspace, they refer to a LAMP of learning model which has seven stages. from bottom to top, the stages are; use, connect, internalise, synthesis, apply and use. Progression through these stages leads to Deep Learning, and puts students in a position to interpret and adapt their learning to suit their own situation. Learning activities are designed to prompt learning through these various stages.

 

This progression is essential in my situation, where consultants sign up for training so that they can incorporate our new organisation model into their existing practice. The PLOT website offers a series of structured assessment and personal planning tools to underpin this approach.

 

Burgess has an excellent structure for creating personal development plans around identified areas of weakness.

1 Learning Objective

2 How will you work towards this

3 How will you know about your progress

4 Progress in reaching objective

5 Evidence

6 What got in the way

7 Further work needed

 

Step 5 requires evidence of progress, which enables the learner to create revised learning plans, taking account of step 6 (what got in the way).

 

In my experience in business, tangible evidence is often absent from the assessment process of an individual's performance. Even in peer assessed situations gut-feel scoring is much more typical and tends to lack objectivity. A client of mine has recently introduced a succession planning process in her company which attempts to overcome this assessment weakness. The leadership competences that have been identified for the future have a spectrum of descriptions which are assigned to be low, medium or high performance indicators. Tangible evidence of performance against the competency spectrum is required in the assessment process with the rating being given after consideration of this evidence. Human Resource staff have been trained to use a positive questioning process with managers who are doing the assessing to ensure the robustness of this evidence.

 

'So what' for my learning disciplines?

1. 
   
   Establishing meaningful criteria against which to assess progress and make action plans is essential. These can be compared against the LAMP model. As I assemble my H808 e-portfolio, I will consider the extent to which the goals I have set myself will provide me with the right framework and revise as appropriate. 
2. 
   
   The PDP structure that Burgess recommends also looks very valuable.
3. 
   
   Incorporating peer review of my progress, drawing on feedback from colleagues is a genuine option for me. I hope that this review process may also serve to educate and inform my colleagues about the potential of new approaches to learning.

 

References:

Burgess, H (n.d.) Self and Peer Assessment (online), The Higher Education Academy: Social Work and Social Policy (SWAP). Available from: http://sorubank.ege.edu.tr/~bouo/DLUE/Chapter-08/Chapter-8-makaleler/Assessment%202_%20Self%20and%20peer%20assessment.htm (accessed 19 August 2009). Professional Learning Online Tool (n.d.) Demo (online). Available from: http://www.plotpd.com/Demonstration/Demonstration.htm (accessed 20 December 2009).

 

E-Learning Design - Reflections

The work on H808 TMA 2 made me go back over some of my H802/H804 reading and has reminded me - gulp - of the shift in teaching focus that is offered by the online medium. Prensky and Schank are strong advocates of a learner centric approach to education.

Although in the back of my mind, I was already aware of this, I now realise that the Distance Learning programme that I have just recently delivered to 8 consultants has, at its core, a transmission approach to teaching. Our Web Tutorials had at least 50% of the time devoted to making presentations of materials, which, to be frank, may have felt uninspiring to the audience.

In version 2, I am considering converting some of these sessions into podcasts, which students can listen to in their own time. The Tutorials could be devoted to conversations about the implications and practicalities of the information provided in the podcast, and other background reading.

However, a much more learner centric model is provided by the Carnegie Case Study which I chose in Activity 6.1. If I were to follow Elizabeth Barklay's approach, I would define a number of learning outcomes, and then offer students a variety of exercises/activities to achieve this learning. Whilst this would be a major undertaking in the short term, if we could achieve the increased volume of students that were achieved in the study, the effort would be well worth it;-)

My most significant challenge in the new course design will be with my colleagues, who are all professionals who are genuine experts in the transmission mode of teaching. I am not sure how wholeheartedly they will embrace my proposals.

Reflective practice and action?

In the model of situational learning presented by Dealtry (2004) , I find myself involved quite regularly in all four categories of learning.

Situation
		Familiar	Unfamiliar
Learning task	Familiar	A A learning task in an area you know well (low risk)	B A familiar learning task but applying it to a new situation (moderate risk)
	Unfamiliar	C An unfamiliar learning task but in a familiar work situation (moderate risk)	D New learning in a new part of the organisation (high risk)

In my case, Box A represents courses of mine that are popular and well established, which customers request on a regular basis. The learning that takes place on/after these events is driven by feedback from participants, which encourage me to consider making small modifications to the way I facilitate the course. Box B learning takes place when one of these familiar and popular courses is booked by a new client. The preparation needed in this case is to research the new context, including interviewing typical course delegates. This research provides material for reflection, which will be converted into modifications to the way that the course is delivered; content, style, duration, assessment etc. Both Box A and Box B are well established routines in my company. Box C is my company's preferred forum for Product Development. We get feedback from our regular market research that there is a potential demand for a 'new' course. Having conducted our research, we would aim to find an existing client who would be willing to partner us in prototyping the event. This means that the only learning that needs to take place is learning about the impact of the new course. Box D is altogether more risky, and would not be my chosen place of learning. However, in order to make that Box as safe as possible, putting a lot of effort (would that be reflection?) into getting to know the context by researching and interviewing the client's business, invariably gives a new course a better chance of success.

The Clegg et al (2002) model of reflective practice in academics has less obvious application in my practice.

	Action	Reflection
Immediate	A Immediate action that follows workshops, often characterised by an instrumentalist approach to instruction	B Reflection-on-action, most usually by experienced practitioners with relevant and immediate opportunities for reflection
Deferred	C Action following reflection does not happen because there is no immediate opportunity to put anything into practice	D Reflection following action is often prompted by formal assessment processes – this also happens after a period of rumination

Reflection takes place in a number of situations; following an event, to respond to a new client need, to respond to competition in the market place, to create a new dynamic in my own business, as a result of fresh research, reading etc. 

Perhaps because my clients are business people, there is a tendency to value tangible ideas, rather than theoretical ones, and whilst many clients require a report at the end of a course or courses, they would expect a series of action recommendations based on our experience. That seems to me to put these reflections in Clegg et al's Boxes B and D. However, in both cases the reflection would result in action, so the separation of these two activities feels forced in my situation.

One other situtation bears consideration; reflection to stimulate action. In my experience, committing to make a presentation or facilitate a course on an unfamiliar subject is a valuable method of forcing myself (or colleagues) seriously to engage in Deep Learning about a subject, and to integrate it into my existing knowledge base. 

Both of these models (Dealtry, 2004 and Clegg et al, 2002) have reflective journals as a key mechanism through which reflection takes place. In my case, summaries of my learning are made, but rarely purely as a learning journal. Much more typical is that the learning is recorded as part of the report given to a client, or appears when the next proposal for a course of a similar type is written for a new client. This may practice may lack academic rigour, but in my experience, it does inform and support the incorporation of my learning into future projects. This enables me to discover whether my reflections had any validity. However, the weakness of this approach means that the drive towards CPD is left to chance.

In creating my e-portfolio for H808, I hope to experiment with creating new routines around reflection that I can incorporate in my professional career.

References

Clegg, S., Tan, J. and Saeidi, S. (2002) ‘Reflecting or acting? Reflective practice and continuing professional development in higher education’ (online), Reflective Practice, vol. 3, no. 1, pp. 131–46. Available from: http://libezproxy.open.ac.uk/login?url=http://dx.doi.org/10.1080/14623940220129924 (accessed 4th December 2009).
Dealtry, R. (2004) ‘Professional practice: the savvy learner’ (online), Journal of Workplace Learning, vol. 16, no. 1/2, pp. 101–109. Available from: http://libezproxy.open.ac.uk/login?url=http://dx.doi.org/10.1108/13665620410521567 (accessed 3rd December 2009).

My own professional values.

My beliefs:

• When people are able to do work that matters (paid or unpaid) they feel useful members of society and therefore feel good about themselves as human beings
• People doing work that matters make a difference to businesses and organisations enabling them to do well
• As a result, society benefits from the above virtuous circle
• Everyone can improve their personal skills and performance, as long as they are willing to take responsibility for this change
• As a learning professional, my job is not only to help people to learn, but also to help them to see the benefit of learning

My professional values therefore include the following:

1. Maintain and develop my skills as a learning professional in business
2. Take an active interest in the context in which my clients are operating
3. Promote excellence in all of my professional interventions
4. Embrace innovation as a key technique in professional and business development 
5. Provide relevant and useful tools and learning experiences to support clients in their pursuit of excellence
6. Keep up to date with technology so that I can offer enhanced learning experiences for my clients 
7. Contribute to an extended global community through which best pratice and learning can be shared
8. Above all, give great service that clients love;-)

H808 Core Activity 7.1 Professional Values

Having reviewed the values statements of four very different professional associations (ALT, BRACP, AMED, RAE), some interesting differences in values and focus are evident.

All emphasize, to a greater or lesser extent, the importance of professional being a credit to their association by pushing themselves to be as knowledgeable and wise about their profession as they can be. In some cases this means that professionals have to meet stringent entry standards, and must be prepared to continue their professional development, and to share their knowledge and experience with others in the association.

Of the four, BRACP and RAE have a much stronger emphasis on the service aspects of their duties as professionals (counselling and psychotherapy on the one hand and engineering on the other).

Perhaps because of the intensely personal relationship that a client develops with a counsellor or therapist, there is a heavy focus on the professional relationship with the client and the quality of outcome that the client can expect. Alleviating personal distress and enhancing the quality of relationships between people are explicit examples of this bias. There is also a strong emphasis on a promoting the role and benefit the profession offers to society. Respecting human rights and dignity and striving for the fair and adequate provision of counselling and psychotherapy services are important enough values to be clearly articulated.

The Royal Academy of Engineering launches their statement of ethical principles with a description of the role of the engineer as being to "work to enhance the welfare, health and safety of all whilst paying due regard to the environment and the sustainability of resources." And whilst professionalism and professional development is clearly at the heart of their ethical principles, these qualities are described much more from the perspective of the value and service that these principles provide to society (Professional engineers have a duty to ensure that they acquire and use wisely and faithfully the knowledge and skills needed in their work in the service of others.)

The Association for Management Education and Development, a UK association which is open to anyone operating in the field of organisation development, places much greater emphasis on the context in which their work is operating. Their values identify important elements that undoubtedly have a significant impact on the effectiveness of OD initiatives; the relationships between people and the organisation, change as a key catalyst in development, the contribution of development to the changing world. The skills and knowledge of members is not mentioned, although openness to feedback is.

In the case of ALT values, particular focus is given to the integration of the two key areas of expertise - technology and learning, both of which play a part in the effectiveness of the ALT professional. ("Learning technology is the broad range of communication, information and related technologies that can be used to support learning, teaching and assessment")

That duality of competence may also account for the fact that learning from others outside of their background and specialism is seen as an important value. In the rapidly changing territory which technology inhabits, the emphasis on being up to date with developments and being open to inputs from other professionals seems essential if Learning Technology is to emerge as a viable and relevant profession.
1. A commitment to exploring and understanding the interplay between technology and learning

2. A commitment to keep up to date with new technologies

3. An empathy with and willingness to learn from colleagues from different backgrounds and specialisms

4. A commitment to communicate and disseminate effective practice

Since the profession of Learning Technologists is very embryonic in its evolution, its values and principles are likely to be at a similarly formative stage. However, the lack of client or learner focus in the current value statement would seem to be a significant oversight, as is the absence of any higher purpose in the application of the professionals' skills.

References:

Association for Learning Technology (2006) Documents (online). Available from: http://www.alt.ac.uk/documents.html  (Accessed 30th November 2009)

British Association for Counselling and Psychotherapy (n.d.) Ethical Framework (online). Available from: http://www.bacp.co.uk/prof_conduct/  (Accessed 3rd December 2009)

Royal Academy of Engineering (2007) Engineering Ethics. Available from: http://www.raeng.org.uk/societygov/engineeringethics/default.htm (Accessed 3rd December 2009)

The Association for Management Education and Development
http://www.amed.org.uk/ (accessed 3rd December 2009),

H808 Activity 6.2 Best Practice Examples: 2

Of the four case studies I looked at, the second most interesting was th Carnegie Academy for the Scholarship of Teaching and Learning, (CASTL) Higher Education Program, http://cms.carnegiefoundation.org/gallery_of_tl/supporting_the_process_of_building_and_sharing_knowledge.html
Creating and Nurturing Robust Intellectual Communities

The e-portfolio describes the learning environment in which Carnegie Academy for the Scholarship of Teaching and Learning scholars are able to document and share the progress of their research projects. They describe this workspace as scaffolding for a group of post graduate research students.

Some important principles that would seem to promote and support the learning of these students are:

The Collaborative Workspace serves as an excellent arena for students to showcase their learning. This would be a great example innovation in the design of learning environments.

Much emphasis seems to be given to the use of the snapshot tool. As I understand it, this is a tool which creates a pdf document of an original document or webpage? From the teaching point of view, this seems to be an example of an innovative use of technology to create presentations.

Students are required to give progress reports throughout their project, and this structure must encourage a reflective approach to learning. This could be given as an example of good teaching and learning support.

The fact that each progress report requires the student to respond to a template of open ended and searching questions is an example of an innovation in learning design, which will encourage individual learning and critical thought.

More generally, the posting of these progress reviews in the collaborative workspace creates an environment in which (formal or informal) peer review can thrive. This is an example of the teachers establishing an online community of learners in which learning from other students is potentially as important as learning from traditional academic sources.

Finally, the regular publishing of students research activities also provides the evidence for teachers to assess student progress, and to evaluate the effectiveness of the programme.

Whilst I would not necessarily see this as a stunning example of best e-learning practice, it does show how a period in which students are doing research can be elevated to a group learning experience and would be a neat device that could be added to many programmes, whether or not they were fully delivered online.

Madeleine

H808 Activity 6.2 Best Practice Examples:1

Elizabeth Barkley: From catastrophe to celebration - an analysis of a curricular transformation
This is a compelling case of an improvement in educational performance, that I would like to nominate it as an example of best practice; it is a general education music course in a community college in  Foothill College, Los Altos, California which was heading for disaster back in the mid 1990s. The course was seeing a progressive reduction in admissions which alarmed and discouraged the teaching staff.

The professor, Elizabeth Barkley set about a fundamental redesign of everything about the course; content, design, delivery, assessment and so on. Over a 6 year period, the changes that were introduced transformed participation levels; from a low point of around 45 enrollments per year registration levels increased by 1638% - from 45 enrollments to 782. Assessment of the extent to which deep learning is being achieved was also very positive. Word of mouth from happy students has contributed to the popularity of the course with new student enrollments, the course becoming one of the most popular on the campus.

I have identified best practice examples using several of the characteristics of excellent teaching from NTFS, referenced by Goodyear et al (2001). 

Innovation in Design and Delivery
The new course makes a priority of student engagement with the material. This was done by looking at the learning outcomes that an adult education general music course should achieve, and then linking that back to music genres that would engage the interest to the students. The solution was to focus on the music the five major ethnic groups resident in the USA. The tradition approach in music education of focusing on largely European, classical repertoire was abandoned.

Ability to organise and present material
Students allowed to choose f2f, electronic, or combinations of both for learning. There was immense flexibility in the combinations that students could choose.

Ability to stimulate independent learing and critical thought
Students are encouraged to take ownership of the creation of their own programme of music learning, taking advantage of the modular approach to delivering the curriculum.

Effective and Sympathetic Guidance of Advancement
The aim was for Authentic Assessment using what Barkley calls backward design. This identifies the deep learning outcomes that are required, and then positions a range of activities through which students can achieve this deep learning, and also demonstrate that they have done so for assessment purposes.

Recognised Commitment to Scholarship
The theoretical underpinning of the new course is documented, and a second e-portfolio continues to analyse the development of scholarly thinking around this innovative new course. Students are encouraged to participate in the compilation of this review portfolio. 

Finally, I found the the format and presentation of this portfolio most inspiring, and it has given me many ideas about how to create my own e-portfolio. A combination of video, audio, photographs and graphics surround the text based artefacts most tastefully.

Madeleine

References
Capturing Change A Tale of Two Portfolios             

Elizabeth Barkley

http://web.mac.com/elizabethbarkley/BarkleyPortfolioPortal/Welcome.html 

Goodyear, P., Salmon, G., Spector, J.M., Steeples, C., Tickner, S., (2001) Competences for Online Teaching: A Special Report, ETR&D, Vol 49. No 1. 2001. pp65-72 ISSN 1042-1629

Core Activity 5.5 LSN certification

Having reviewed the CMALT and LSN E-learning competency frameworks, it appears to me that each approaches the challenge from a different angle; the ALT approach focusing more on adding learning on to technology skills and the LSN focusing more on adding technology to learning skills. The LSN approach fits most closely to my own situation, where I am aiming to add an e-learning dimension to my learning portfolio. I have examined how my PDP outcomes might earn me credit under the LSN accreditation scheme.

Not surprisingly, since my learning goals are focused on a current live e-learning programme, the majority of my goals fit under the Practitioner section of the Framework, but since the programme is a pioneering one in my own company, there are also a few design, leadership and staff development angles that will emerge from this PDP.

1. Awareness of Students and their learning needs
My plans to increase my awareness of student knowledge and special needs and to incorporate the learning into future programmes sits under the following LSN competencies:
LSN Competencies:
Practitioner: induct and guide learners entering and e-learning programme.
Developer: Develop e-learning materials and content
Core:What systems, resources and support are required for implementation

2 Creating the right online atmosphere
My plan to monitor and respond to learner participation and interactions fits under the following LSN competencies:
LSN Competencies:
Practitioner: monitor utilization of e-learning and related technologies
Practitioner: Interact with e-learners online/monitor utilization of e-learning and related technologies

3 Generating stickability
The study on learner motivation will qualify under the following LSN competency:
LSN Competency:
Practitioner: monitor utilization of e-learning and related technologies

4 Ability to use IT appropriately
4a Understanding of online course design: how to write online teaching material, how to design online activities, how to transform teaching or training material for the online environment.
LSN Competencies:
Design and Planning: Design and plan programmes that incorporate an e-learning component.
Practitioner: Identify resources for e-learning interventions/establish an e-learning environment.

4b Experience of audio and visual facilities of the web; for example, Netmeeting, Skype, digital photos, webcasting, podcasting
 LSN Competency:
Practitioner: Use specific e-learning tools relating to one’s own work role

4c Understanding of the different text-based communication systems: computer conferencing, bulletin boards, listserves etc
LSN Competency:
Practitioner: Use specific e-learning tools relating to one’s own work role

4d Skill in developing online community: what works and what doesn’t; providing focus, animating online groups, developing collaborative activities
LSN Competency:
Practitioner: Monitor utilization of e-learning packages and assessing effectiveness

5 Student Assessment
5a&b Ability to mark to the department’s standards
LSN Competency:-leadership: Evaluate performance of e-learning systems, tools, policies and procedures.

5c Written feedback on assignments
LSN Competency:
Practitioner: Interact with e-learners online in…..assessment roles.

6a Steps taken to improve your teaching
LSN Competency:
Advisor: Support staff development in e-learning.

7 Organisation and record-keeping
I am not convinced that this objective is specific to an e-learning goal.

8 Collaboration with teaching colleagues
LSN Competency:
Design and planning: Support staff development in e-learning.

H808 Core Activity 5.4

I find myself agreeing with you, Eugene, on your conclusions about Learning Technologists.

Here is my picture of what has been going on in education. We have an established group of professionals, teachers/academics, who find themselves in situ when the biggest revolution of the modern era comes onto the scene - information technology, and its partner revolution, the internet/www.

What becomes obvious to pioneering distance educators such as the OU, is that this new medium (internet) and tools (IT) can transform the way learning is delivered. The potential of this medium is seized upon by management, but the implications of this new direction have to be delivered by the institution. Since teachers and academics are/were totally unqualified to operate in this new digital domain, someone needed to fill the gap - enter a brand new person, the learning technologist. I see this person (under 35, technologically qualified) as being the bridge between the teachers and the IT experts; someone who knows enough about IT AND enough about the specific learning situation to recommend/provide tools, platforms and support wisely.

Incidentally, this same digital transformation is going on in (every?) professional discipline today. Spreadsheets have transformed the job of accountants, CADCAM technology has transformed the job of design engineers, Enterprise Resource Planning systems have transformed the job of production planning engineers and purchasing professionals. So is education any different, or does every profession have its own equivalent of the learning technologist?

Others will have their own opinion about this, but I suspect that the individual focus of the learning process makes the job of the learning technologist much more specialised than that of an IT service provider to other professions. And, let's say that there is a separate and important professionalism called a learning technologist, is it simply a matter of time before the next generation (digital native) teachers and academics with a much more instintive feel for technology will gradually incorporate the role of learning technologist into their own role?

In my own practice, we use Tom Peters' (1999) model of Professional Service, one key element of which positions the job of a Professional Service as being one in which the Professional educates their client to be able to serve themselves. In the meantime, the Professional is developing themself to the next level, and is in a position to serve their client once again at the next level of competence.

This is a long winded way of saying that I think there will always be a role for learning technologists, but any professional accreditation that they establish must be about being the experts on what next, not what is.

Madeleine



Peters, T. (1999) Reinventing Work, the Professional Service Firm 50, Alfred A Knopf Inc, New York

Reflection and Emotion

Since re-joining masters level studies in September, I have been reminded of the turbulence and emotion that accompanies the incorporation of new learning into my own thinking process. The period in which new input is being received, either by reading or through conversations of various kinds feels very stressful. Why would that be so? I suppose my existing 'certainties' have been reached over a significant period of time, and have been re-enforced by experience, which embeds them deeply into my sense of what is true. New information either fits in there, in which case, I have to find a way to make the links, or forces me to reconsider and revise my point of view. In a way, both of these scenarios is uncomfortable, which may account for the emotional reaction.. I think the worst part of the process is the part when the outcome feels uncertain. Just how does this fit? Have I been wrong in the past? Where does the new thought connect?
I am wondering whether my mistake is to keep ploughing on with trying to make the links? My normal way of working is to assume that if I work hard and stay focused, I will find the answer. But Anne Miller describes a mental process (in innovation) which is called hypnagogic creativity.

"It's important not to be always "on", because the creative process needs to alternate periods when you are energetically gathering information or thinking analytically with periods of quieter reflection to incubate ideas and listen to your intuition." (p52)

My recollection of Moon's description of the reflective process had a period in which the new ideas were absorbed. I am beginning to feel that it is important that I develop personal strategies for coping with this emotional period.

One strategy, of course,would simply be to take a break when I reach overflow point and deliberately do something that takes my mind off the subject under consideration.
A second idea is to engage in conversation with others who can add perspective to my thinking. One of two of my work colleagues are especially helpful in this regard, as they are well aware of my existing points of view and can counter them well.
The OU is also a place to see solace, either with tutor group colleagues, or possibly in the public areas of H808?
Maybe there are others?


Miller, A., (2009) How to get your ideas adopted (and change the world), Marshall Cavendish Ltd,. London

The Professional Debate

Activity 5.2 encourages us to consider definitions of profession, e-learning, and e-learning professional. I've been trying to get my head around this whole subject, and why it is worth this consideration, and here are some random thoughts.

So just what is a profession? The obvious examples of a profession would be a doctor or a lawyer; probably amongst the longest established professions that exist today. What is characteristic of the status of being a doctor or a lawyer is that you are privvy to knowledge and expertise that has been developed through learning from masters and that this learning is not easily gained. Time, commitment and often sacrifice have been devoted to earning the right to be described as a doctor or a lawyer.

Warrior, in her article, refers to the struggle that has been going on in teaching to establish itself as a respected profession. Progressively over the 20th century, job roles which demand a level of knowledge and expertise that requires commitment and particular expertise have sought to have that status acknowledged. Professional Institutes of all kinds are emerging; IMechE, Institute of Marketing, Institute of Personnel and Development..... and so on. Membership of reputable Professional Institutes is a guarantee of quality: such institutes are therefore concerned with allowing only suitably qualified individuals to join, and to providing members with the wherewithall to keep their professional skillls honed and practiced. As new technology has come onto the scene, IT Professionals have followed the Institutional path; an example of such an institute is the ICCP.

So, the burning question I think we are being challenged to consider is - does a e-learning as a profession deserve a separate professional category? Or do we find ourselves at a point in time when learning professionals have yet to integrate the use of the electronic medium into their normal practice?

Take another professional category - the Purchasing Professional. Anyone wishing to operate in that field today must be familiar with IT systems that enable Supply Chain Management and Enterprise Resource Planning. An awareness of how to use such systems effectively and to incorporate their features and benefits into the Purchasing Function is essential. Is the status of IT in learning any different to that? Is the inherent nature of learning as a profession different to other professions that are incorporating electronic media into their modus operandi?

I wonder what anyone else thinks about this?

H808 Activity 5.2 Professions and Professional Values

My preliminary thoughts around definitions of Profession, E-learning, E-learning professional....

After what has felt like a most unproductive day of reading and digesting input, I return to yesterday's work on what I concluded were the main roles for e-learning professionals in my context:
* Learning Design
* Materials Design
* Learning Environment Design/Management
* Learning Technology
* Course Facilitation
* Coaching/mentoring
* Assessment of Student Learning and Evaluation of Programme Effectiveness
* Staff Development
* Learning Infrastructure Design/Maintenance

These roles are all relevant to a learning professional; someone who has subject matter expertise that is of value to students and who is able to create a context and has the skills and tools to engender effective student learning.

Arguably that definition applies equally to an e-learning professional, but that bald definition would overlook at least three important differences; the remoteness of the relationship between the e-learning professional and the student; the complexity of the electronic medium through which the learning is delivered; the opportunity that electronic media offers to create different relationships with students. Nonetheless, the outcome of e-learning professionalism ought to be the same as a learning professional - effective student learning. So is there a different professional definition? Hmmm.... to be continued;-)

H808 Activity 5.1 E-learning roles

The websites I have visited describe e-learning professionals from two different perspectives; those taking a national/international policy view (EIfEL (European Institute for E-Learning and New Zealand Ministry of Education ), and those taking an institutional or organisational view (Research Center for e-Learning Professional Competency and The Training Foundation). Unsurpringly the former focus much more on policy, infrastructure and management issues, whilst the latter focus on the skillset and competencies needed to deliver e-learning.

In both cases, the start point is assumed to be existing learning and development institutions and staff which require 'conversion' into the use/exploitation of information technology. This is very relevant to my own situation, where my business is keen to develop our existing face to face management training offering to be available in Distance Learning formats. To date, this learning is being provided by staff who have limited experience of operating as learning professionals in an e-learning context. They are, however, subject matter experts in their chosen areas of professionalism.

The e-learning professional roles (derived from the above research) that I believe apply in my own e-learning context are listed below. I have identified what I believe are the main developments that will be needed by the professionals in my context.

* Learning Design

E-learning design has a greater emphasis on constructivist principles and identification of the reflection required to enable deep learning. Designers must develop an understanding how technology/multi media can enable learning interactions to take place.

* Materials Design

Materials are a critical element of e-learning. Rather than just providing content input (which would be typical in the f2f setting), the emphasis should be to promote self directed learning, and prompt questions, connections and debates. Learner independence should be seen as a goal.
* Learning Environment Design/Management

The classroom context in e-learning is very different to f2f, and can only work if the learner chooses to engage actively. Creating the right online environment - building rapport - will be a priority.
* Learning Technology

Build up the team's understanding of the range of technology options (CMC, wikis, podcasting, blogs, e-portfolios, social networking etc) for delivering e-learning. This knowledge must be constantly updated.
* Course Facilitation

More hand's off than in a f2f practice. Encouraging of questions not just delivering content and supervising/debriefs. Less transmission, more discussion and expert 'responder'.
Coaching/mentoring

* The visibility of student reflections provided in the e-learning context enables us to offer much greater student support. Building the right bonds of trust and credibility are essential prerequisites for this relationship to thrive.
* Assessment of Student Learning and Evaluation of Programme Effectiveness

Exploit the opportunities to monitor student learning, such as e-portfolios and online discussions, that are offered in the e-learning context.
* Staff Development

Provide staff with the chance progressively to join in with e-learning delivery (legitimate peripheral participation, Lave and Wenger, 1991) and encourage them to create their own PDP in e-learning practice.
* Learning Infrastructure Design/Maintenance

The learning platforms we will use will be from 3rd party providers.

References:

http://cms.steo.govt.nz/eLearning/Projects/Tertiary+eLearning+Research+Fund.htm (accessed 5 November 2009)Research Center for e-Learning Professional Competency, http://elpco.a2en.aoyama.ac.jp/EN/index.cgi (accessed  6^th November 2009).
The Training Foundation, http://www.trainingfoundation.com/index.asp (accessed 6th November 2009).  

EIfEL (European Institute for E-Learning), http://www.eife-l.org/ (accessed 5 November 2009)
Lave, J. & Wenger, E. (1991), Situated Learning: Legitimate Peripheral Parcitipation, Cambridge University Press, Cambridge, UK.

New Zealand Ministry of Education (?) ‘Tertiary (e)Learning Research Fund’ (online). Available from: Available from: http://cms.steo.govt.nz/eLearning/Projects/Tertiary+eLearning+Research+Fund.htm (Accessed 5th November 2009)

EC: Web Tutorial 4 Some random thoughts

The fourth and final FSW web tutorial focused on the Excellence audit results and how to interpret them. As pre-work, delegates were all asked to complete the audit themselves, so that they could understand the experience their clients will be going through. They were also provided with results from  a real audit, and were asked to read through the practitioners guide section on the audit, and to begin to work out how they would interpret the data.
From the outset, it was clear that a couple, notably Gary and Berta, had spent time studying the data. Others may well have done the same, but did not speak out so confidently in the discussions.
The content delivered by us was quite significant, and I am still very thoughtful about whether this was the best way to deliver the material. For those who had studied the case study, it was probably fine, but others may have been a bit overwhelmed.
The dilemma over whether we should present any content in the webinar format is still on my mind. We will be issuing feedback questions to investigate the experience of the learners, and I am most interested to explore this question. There is no doubt that the students are hungry for input, but I am wondering whether that input needs to be more driven by their questions than by our description of our model.

TMA 1, What was Different?

TMA 1 was the first experience of putting together an assessed academic document in my new 'e-portfolio' era. I want to step back here and think about what was different, compared to my previous H802 and H804 experiences of TMAs.


The TMA 1 fell into two parts, one of which was a reflective summary, and the other of which was a more traditional critical reflection on the main learning of Blocks 1-4 of the course. 


What was noticeable to me was that, as I had gradually cottoned on to the discipline of recording, organising and tagging my course work, the orderliness of my TMA reflections improved. So the least well organised thinking was from blocks 1 and 2 of H808, when I had really failed to grasp the full significance of what the modules were meant to be teaching me. This was a point that I had picked up in a couple of earlier blogs.


The reflective summary felt a great deal easier to complete than the normal academic assignment, as I had kept a pretty good record of my thoughts using my blog right from the very start. I suspect the other reason that it was easier was that I was working with material that had come from my own head, rather than having to describe material that is presented by others. 


A second piece of learning, picked up from previous H80X experience, was that in my planning for the TMA, I outlined the main sections of the assignment, and limited myself to the right general proportion of words per section, in order to meet the TMA requirements. Although there then had to be some editing and reshaping of the final version, I am convinced that I wasted much less time than previously on too many words.


Another discipline that was new was that, having outlined the main sections of the assignment, I left the sections that I thought were the easiest (usually the introductory sections!) until the end, beginning with those where there were the most significant 'gaps' in my thinking. This had the emotional effect of me feeling relieved the closer I got to the finishing line - rather than the opposite effect of feeling like the steepest hills were still left to climb!


One slight confusion was that I have material stored in a few different places. I am tending to gravitate towards Google apps as the main organising centre for my thoughts, as it is such a ubiquitous application, and is incredibly easy to access. However, the formats and range of files types supported do make its use a bit limited. And the fact that the labelling of documents across the Google apps family is not identical is a bit frustrating. But I suspect the main issue for me to come to terms with is the need to be orderly right from the outset - not a natural mind set for me, as I have reflected previously.


So the mental notes to carry forward for the rest of H808 (and maybe my life?!) are;

1. When reading and studying, store and oraganise new material with future use in mind (TMA/EC/work projects)
2. At the outset of every piece of academic work, be clear what I want to get from the activity
3. Where word limits apply to a piece of work, set these limits at the "organising of thoughts" stage
4. Where possible, convert outside inputs (academic or otherwise) into a blog posting, so that these thoughts can begin to be incorporated into my own more fully.

In conclusion, I suspect that the big breakthrough on TMA1 was that being more organised makes the compilation of thinking for TMAs much more efficient. It remains to be seen whether the quality of what was produced is as good as, or better than, previous attempts;-)

H808 E-Portfolio: Web Tutorial 3 Review

In Sessions 1 and 2, we have focused on explaining the background to our organisation model, Future Shape of the winner, and having the students study it and get used to articulating the main features of the model.


In Session 3, we want to move on to have students start the process of integrating FSW into their existing practice. We decided to prompt this thinking by setting some background reading on how the model connects with other well known management theories, and then to explain three case studies which outline the way that we have integrated the model into our practice. These case studies elicited a number of questions, that were at quite a practical level, and indicated to me that students were putting themselves in the position of using the model and having to make sense of its findings. One contacted me after the Web Tutorial with the following comment:

"This is becoming a lot clearer in my mind and am getting a lot of confidence!"

This seems to be an example of someone discovering how to integrate this new knowledge into their existing knowledge bank.


I remain uncomfortable with medium of the webinar platform, and am not convinced that it is the best for presenting data. And whilst the telephone contact enables us to have discussions and answer questions, it is still an imperfect way of judging the audience reactions to the material. 
However, the benefit of the teleconference is that the community of the programme is beginning to strengthen, and students are showing an obligation to each other to contribute. Being honest, the mindset that is probably the most important to shift is that of the tutors, including myself, whose background is almost entirely face to face training. Becoming comfortable with a style of teaching that relies much more on the learner to make sense of the material is difficult, and may not at the outset feel so personally rewarding, but is essential in the Distance Learning arena.


By the end of this first programme, I aim to be able to map the key learning inputs that are essential for the programme, and find ways of delivering that material through a more suitable medium; podcasts, videocasts, quizzes ...etc. And I would want to identify which are the most important subjects for discussion. Setting up activities that engender the right discussions will be the next challenge.


But all in all, we are managing to have the right conversations, and the confidence our students are developing for the material is most heartening.

My Mental Block around E-Portfolios

The first six weeks of H808 have been a period in which I have felt extremely confused. I have had these same emotions on previous H80X programmes, and I have found that if I can trust the expertise of the Open University's course designers, the fog will eventually clear. Or perhaps to be a bit more theoretical about the description of this process, I will find a way to integrate the new knowledge into my existing knowledge bank.

My confusion has largely been around the use of the e-portfolio. The idea of having an electronic place to store, organise and retrieve pieces of work or pieces of interesting research or information is a straightforward enough idea, particularly in the era of Web 2.0. My confusion has arisen around how an established professional, with many years of experience and insights, and with a multitude of uses for an e-portfolio, would begin to set up and organise one.

On reflection, maybe the root of my problem is that I am not someone who thinks in a linear way. My first degree was in Music, and my Belbin team role is Plant; I have always considered myself to have a more creative than scientific mind. Organising thoughts at a meta level is not my strength, and I am lucky to have a business partner for whom this comes naturally. This may therefore have let me off the hook with this discipline in a work context.

My H808 confusion has arisen because I did not grasp quickly enough that to use tools like My Stuff, de-licious, and Google apps (these latter two highly recommended by H808 colleague Eugene), I must first decide how to sort and store my data. When I went back into My Stuff after 5 weeks of collecting, the tags were chaotic, to say the least.

So, I decided to become intensely practical, and to organise my thoughts around the immediate challenge; H808 activities. With that in mind, I was able to organise the My Stuff tags, which meant renaming a few tags, housekeeping the tags I had set up to avoid duplication, and revisiting those artifacts already stored there to include as many tags as are relevant. I then moved on to my Google Docs Application, and carried over as many of the My Stuff tags as are relevant to this (work based) project. Some additional tags were needed to reflect the H808 Skills and Competencies requirements of the EC. And lastly, I revisited the tags I had set up on De-licious, and discovered similar chaos to the other two repositories. Again, I have done an editing and clearing out job here, and have tried to maintain tag consistency with Google and My Stuff.

This all feels as if I have managed to clear out a cluttered kitchen drawer;-)

It will be most interesting to discover whether I am able to hold myself to the discipline of organising my thoughts, my work and my reading beyond H808. I suspect that I will, as my unease with the early clutter of H808 mirrors my general unease with the amount of data that is available in the world today. The explosion of information over the last 10 or so years that the internet and the other publishing media are generating has felt, at times, overwhelming. Having a way of categorising and then storing information which adds value to my practice and my hobbies is beginning to feel like a watershed in my cognitive mapping process.

FSW DL Reflection tool (1)

In an earlier blog posting (Reflecting on Reflection, 2nd October 2009), I described a moment of realisation about my own professional practice. I have tended to assume that allocating time for my students to reflect assumes that they will know how to reflect. My research around the subject of reflection has given me pause for thought on that subject.

I decided this week, to provide some extra scaffolding for reflection on the Web Tutorial. On this session, all students had been asked to prepare a five minute input summarising their learning on a section of the course manual (Practitioner's Guide). Listening to any subject tackled 8 times can be both tedious and challenging; I therefore provided a Reflection Tool for everyone to use if they chose. The tool listed all the names of students, and invited the listener to record their answers under three headings; features benefits that they focused on, powerful images/phrases, ideas to incorporate into your pitch, any questions.

Students have been invited to contribute to a blog discussion following that session, and I will be fascinated to see if there any good evidence of listening and reflection.

H808 E-Portfolio: Web Tutorial 2 Review

The second web tutorial in our series of four took place on 19th October. Students had been assigned pre-work of studying five sections of the Practitioners Guide describing the Future Shape of the Winner organisation model and prepared a five minute input to describe the features that they judge to be unique.

This exercise allowed us to judge their early grasp of the model and also to get a sense of their presentational capabilities, albeit in the limiting arena of a teleconference.

We audio recorded this conference, which provided my colleague and I with the opportunity to review the inputs of students, and make a more considered assessment of progress.

Two had clearly developed an excellent understanding of the model and were able to relate the model to their existing mental models around organisations. Four showed good understanding being able to articulate the model well, and two, both native Spanish speakers were more limited in their grasp.

In one case, this may be due to the student's poor spoken english; this student's presentation showed signs of his questioning whether the model can truly be useful in his practice. In the coming weeks, I must monitor the situation with both students, to decide whether additional learning support is required.

Today's review will support my PDP in two areas; Assessment and Awareness of Students. In carrying the review out with my colleague, I was also improving our collaboration on e-learning.

Memo: Extracts from PDP Goals which are being addressed in this activity
This is the first programme that we have developed in this field. I will work with colleagues, and research best academic practice to establish the criteria against which we will judge the performance of our learners.


I will engage my colleagues in the assessment process, which will give me a benchmark to judge my own assessment competences.

Structure for my H808 E-Portfolio

Structure for H808 E-Portfolio: Madeleine McGrath

H808 is designed to help students to develop their understanding of what it means to be an e-learning professional in a period in which this medium is in its relative infancy. A major element of the module is for students to create an e-portfolio as a record of their learning and development during H808. This document outlines how I intend to organise my e-portfolio artifacts in order to meet that course objective.

Structure for Storing Artifacts

The H808 Course Guide provides us with a Personal and Professional Development Template, and we have also been required (activity 3 part 2) to conduct a Needs Analysis of the areas in which we require development. These two frameworks will guide the structure of the collection of my e-portfolio artifacts.

The tagging structure I will use to label artifacts will be as follows:

Areas of Practice

H808EP Skills

H808EP Reflection

H808EP Critique

H808EP Proactivity

Competencies

H808EP Practice

H808EP Communication

H808EP Technology

H808EP Research

These tags may combine both areas of practice and competencies in the following format (H808EP Skills/Practice).

I plan to use the same tagging structure in 2 e-portfolio repositories. The OU's My Stuff Repository will be used to collect artifacts related to the H808 learning, and Google Apps will be used for artifacts relating to my Work Based learning. This division is to enable me to continue to use an e-portfolio after my OU incumbency, assuming that the experience of using one proves valuable in the long term.

Connecting PDP with H808 Personal and Professional Development Template (PPDT)

My PDP has highlighted 8 meta skill categories (Prefixed below with MS) and 17 individual skills (Prefixed below with S) that will benefit from attention during H808 and beyond. Some of these fall into more than one area of competency.

Here is how they can be plotted against the PPDT areas of competency:

Practice

MS 1a-c. Awareness of students and their learning needs

MS 5a-c Student assessment

S 4a Transform teaching material for the online environment

MS 6a Steps taken to improve my teaching

Communication

MS 2a-c Creating the right online atmosphere

MS 3a Generating 'stickability" (Learner persistence)

S 4d Developing an online community

MS 8a Collaboration with teaching colleagues

Technology

MS 3a Generating 'stickability' (Learner persistence)

MS 4 a-d Ability to use IT appropriately

Research

MS 6a Steps taken to improve my teaching

MS 7 Organisation and record keeping

Each area of competency may have evidence of skills, reflection, critique and/or proactivity development.

Sources of Artifacts

Evidence of my development/performance against the PPDT elements will be drawn from:

• Forum postings from H808
• Selected H808 activities
• Relevant academic research
• Www sources
• Previous H80X ECs and TMAs
• Specially created documents to chronicle relevant aspects of my work based Distance Learning Project
• Audio and other AV records from my work based DL Project

MM Personal Development Plan.rtf

H808 PDP: Madeleine McGrath

	Overview
	I am currently leading a team who are running a 5 week Distance Learning Programme for consultants to train them in the use of my company’s Organisation Development model. Successful consultants will be granted a license to use this product with their own clients. The programme has been developed in the light of my experience of designing and facilitating an online module as part of my H804 studies, and following my occasional use of webinar technology to make presentations to dispersed audiences. I plan to use the experience of running this programme to develop my skills as an e-learning professional. I judge the following skill areas to be the most promising places to make improvements.
	Skills and Competences	Existing competence level		Improvement Actions/Goals
1.	Awareness of Students and their learning needs	Memo: this was an area that was judged lacking in my H804 EC.
1a	Understanding of students’ knowledge base	The current process uncovers the students knowledge base from student cvs and registration documents		Experiment with ways systematically to find out the existing levels of knowledge of my learners in future programmes.
1b	Knowledge of students and their backgrounds	The registration process asks questions about the professional, academic and personal backgrounds of learners		The existing process will be reviewed, and more searching questions included in future if necessary.
1c	Awareness of individual and special needs	This information is currently derived from the current registration process.		Identify specific learning needs based on findings from 1a and 1b, and the experience of the first programme. Introduce a more searching inquiry process if necessary.
2	Creating the right online atmosphere
2a	Use of voice and gesture	We currently have both voice and online communication with learners.		Monitor the online/telephone responses of learners to my and my colleagues inputs.
2b	Ability to include all students in discussion	The telephone conference format makes it difficult to ensure everyone can participate. A number of strategies to support this have been introduced on this programme. The success of these strategies will be reviewed at the end of the programme.		Monitor participation of learners in telephone and online conferences, and investigate any disappointing participation levels. Identify strategies to encourage optimum participation in the learner’s circumstances.
2c	Ability to create a suitable atmosphere in groups	The various learning arenas (blogsite, webinar, Linkedin) I have chosen give my colleagues and I a variety of ways of judging whether we have been able to generate a group dynamic.		I will monitor participation in group sessions/arenas, to decide on any improvements for future events. The long term test of success in this factor will be whether learners choose to remain active members of our online community after the end of the programme.
3	Generating stickability	Memo: this was an aspect of my H804 project that I found most disappointing.
3a	Ability to engage students	Persistence levels of learners have been variable in past programmes of mine – from not even participating though to erratic, unreliable participation up to enthusiastic and energetic participation. Participation is important to this programme, as it gives us visibility of learners who will be representing our products in the market place and assists in our assessment of their capabilities.		Though observing any differences in participation levels of learners, identify the factors that do/will motivate learners to participate in our programme, and incorporate as many as possible into future programmes.
4	Ability to use IT appropriately
4a	Understanding of online course design: how to write online teaching material, how to design online activities, how to transform teaching or training material for the online environment.	Our current programme has a blog, an audio webinar platform, participant guide book and a mentored assignment as its learning methodology.		In order to turn this programme into one that can deliver high quality training to larger numbers of geographically dispersed students, it is vital that our basic programme includes a much greater proportion of asynchronous activities. The experience of the first programme will provide insights into the activities and discussions that are essential in our learning process. This learning can be incorporated into the next design of the programme. The fact that we have chosen technologies for the first programme which give us visibility of the process learners are going through will provide valuable insights into the actual learning process that is taking place.
4b	Experience of audio and visual facilities of the web; for example, Netmeeting, Skype, digital photos, webcasting, podcasting	The current programme uses webcasting (which is called webinar in my field).		In future programmes, I envisage much greater use of podcasts to replace some of the webinar inputs, and will be very interested to experiment with the use of Skype and its video conferencing capabilities.
4c	Understanding of the different text-based communication systems: computer conferencing, bulletin boards, listserves etc	The current programme uses a webinar platform for synchronous communication and a blogsite for asynchronous communication.		It is my aim to migrate the programme gradually to incorporate a greater proportion of asynchronous communication. This will make the programme more time efficient for tutors and learners, and will give us much greater scalability of numbers of learners.
4d	Skill in developing online community: what works and what doesn’t; providing focus, animating online groups, developing collaborative activities	We are using two online community platforms; blogger and linkedin..		Monitoring the community dynamics of the first programme will give us data to assess our community building capabilities and identify areas for improvement. The ultimate test of this competence will be the extent to which learners stay active in this learning community after the programme has finished.
5	Student Assessment
5a	Ability to mark to the department’s standards	No previous experience	This is the first programme that we have developed in this field. I will work with colleagues, and research best academic practice to establish the criteria against which we will judge the performance of our learners.
5b	Consistency and reliability in marking standards	No previous experience.	I will engage my colleagues in the assessment process, which will give me a benchmark to judge my own assessment competences.
5c	Written feedback on assignments	At present I am not required to provide written feedback to learners. This programme will therefore provide my first experience of this.	The experience of providing feedback for the first time will be a valuable learning experience for me. I shall reflect on that experience and ask for feedback from colleagues to help me to hone my skills in this area.
6a	Steps taken to improve your teaching	This programme was created based on my previous H80X experience and in particular the experience of designing and facilitating three online modules in H804.	The items in this Action/Goals column provide a template against which I will develop my e-learning skills for the future.
7	Organisation and record-keeping	Since this has been a prototype programme, the documents and records have been created using our best instincts and prior experience, which is largely of face to face training.	In the light of our experience, I will analyse the documents and course materials that we have used, and streamline their use and storage.
8	Collaboration with teaching colleagues	On the programme to date, my colleagues have collaborated in supporting the delivery of my course design, although this has largely been rather passive collaboration.	I will involve colleagues in the end of programme review, and encourage them to take part in the design of future programmes. This will improve the quality of future programmes, and will increase their ownership of the programme in the future.

Adapted from Source: H851 Practice Guide 7, Reviewing and Improving your Teaching, The Open University, 1998, p.31. and Technology related skills and competences for e-learning professionals, Robin Mason.