Transkrip penuh untuk Mark Brown: Learner ownership is at the heart of the portfolio

the DCU-wide implementation of Mahara, and I formally retired from my position at DCU at the beginning of 2025. 00:03:17.699 --> 00:03:41.900 When you mentioned that you started your tertiary career at the age of 25, which triggered the reminder why you are so passionate about and also very active in the wider community of open, distance, flexible, and online education because you are also very active in ICDE and other organisations, including also FLANZ. 00:03:42.219 --> 00:03:42.400 Indeed. 00:03:43.150 --> 00:03:57.400 And so, Mark, you were on the original project team for the development of Mahara in its initial year. Can you share a bit how the project came about and what you wanted to achieve with it? 00:03:57.439 --> 00:04:28.144 Sure. First, I think it's important that I give much of the credit for writing the Mahara funding proposal to my colleagues Mark Nichols and Bill Anderson. Also, Richard Wyles was the technical and conceptual guru. To be honest, the success in securing an eCDF government funding grant came as quite a pleasant surprise, as the project was particularly ambitious for what was meant to be just a one-year funding round or cycle. 00:04:28.579 --> 00:05:15.370 As an aside, I think our understanding of sustainability in the edtech field has matured significantly since the start of the original project. Even though at the time our commitment to an open-source platform was central to this goal, I don't think any of the project team could envisage just how Mahara would continue to be used around the world 20 years later. What an amazing achievement! At the time of the original project, I think a strong focus was really placed on an ePortfolio for critical reflection and lifelong learning. The lofty goal in Europe, championed by EIfEL, of an ePortfolio for all by 2010, was particularly influential. 00:05:11.079 --> 00:05:27.954 The overarching mantra, if you like, was ePortfolio for every citizen. You need to remember that when we were working on Mahara, a public version of Facebook had yet to be launched. 00:05:23.814 --> 00:05:32.064 The digital world was only just emerging. Even blogs were a new thing back in those days. 00:05:32.064 --> 00:05:43.180 However, it was clear to us that the world was rapidly going digital, and a place to store, document, manage, and critically reflect on your lifelong learning made a lot of sense. 00:05:44.500 --> 00:06:00.850 Originally, lifelong learning was very much the focus of the project, more so than the institutional portfolios or using portfolios for assessment purposes. Why did you put so much focus on the lifelong learning aspect, Mark? 00:06:02.079 --> 00:06:13.149 Yes, as you say, the original goal was much wider than simply promoting ePortfolios at an institutional level or as part of assessment. 00:06:09.160 --> 00:06:43.824 I think we actually saw this institutional focus as limiting the scope of the wider potential of ePortfolios. One of the underlying principles in the project development was learner ownership. There was a risk that we saw between a strong focus on institutional portfolio development in undermining that principle of learner ownership and the wider goal of promoting critical reflection and lifelong learning, so there was a tension there. 00:06:43.870 --> 00:06:54.819 We also saw the strong potential of Mahara to be a social networking tool for learners, where they connect with other learners across institutions. 00:06:50.500 --> 00:07:06.850 The social networking feature of Mahara recognised that the origin of metacognitive thinking and critical self-reflection, or if you like, learning how to learn, really resided in the social interactions with other learners. 00:07:07.410 --> 00:07:44.144 There was also a tension with this wider focus on the institutional driver, as actually several of the members of project team, me included, were involved in academic programme development and programmes that were ideally suited to the implementation of an ePortfolio. So we lived with this tension throughout the development, and it wasn't by accident that the different views that a learner could create in the platform could also be used to support the different uses or forms of portfolio, including a showcase of achievements. 00:07:45.250 --> 00:08:17.125 What also comes to mind is when you mentioned that in Europe there was the initiative for portfolio for all, there was also one in Minnesota where, at one point, also in the early 2010s, every person could have a portfolio and use it in particular for job applications and so on, but due to funding, that project did not continue, unfortunately, but it also had that very much lifelong view. For which programmes did you originally develop the portfolio ideas, Mark? Was that for education? 00:08:17.939 --> 00:08:30.139 Yes, it was not surprisingly, given what we know about ePortfolios and where they seem to sit naturally in inverted commas, was a initial teacher education programme. 00:08:30.379 --> 00:08:41.090 That programme was being redesigned from the ground up, such that we were able to build a portfolio into it rather than grafted onto an existing programme. 00:08:42.080 --> 00:08:44.419 How was the uptake then in the programme? 00:08:44.419 --> 00:08:54.669 Did people come on board easily to the idea, or did they need a bit of convincing since it was pretty new to them of how to engage with learning that way? 00:08:55.519 --> 00:09:13.940 Well, the key members of the programme team were also members of the Mahara project team. One would have thought that we would be very successful in implementing that initiative, but as it turned out, we all moved off into different roles and positions. 00:09:09.350 --> 00:09:31.475 Mark Nichols took up a position at the Open Polytechnic. Bill Anderson and Mary Simpson left to take up roles at Otago University in the College of Education there, and I was seconded into a role in the central university, as I described

previously, as Director of Distance Education. 00:09:31.820 --> 00:09:55.309 There's a lesson in this, which I'll probably touch on at some stage in the podcast about the importance of leadership and the need to build that leadership underneath those who are the initial champions. In the end, the programme didn't really live up to expectations, I think it would be fair to say, in the manner in which ePortfolio were embedded into it successfully. 00:09:55.929 --> 00:10:46.840 We've seen that over the years that it is so important to have appropriate and sufficient support for programmes, and also the backing of the management to roll portfolios out and make them successful. To fulfil the vision of that lifelong portfolio, myportfolio.ac.nz was created, which was essentially a multi-tenanted Mahara site, so that every institution could be on one site, and no matter whether the students switched their universities or tertiaries, their portfolio would continue to be in one place. Was that the main goal of setting up myportfolio.ac.nz, or was there anything else of why you had immediately envisaged this more country-wide instance? 00:10:48.080 --> 00:12:00.274 I'm having to rattle my brain to think back to how that came about. I believe it was linked back to the issue about ownership, learner ownership. The key question that we were trying to address was how could we find a place where learners could develop their ePortfolio and retain their ownership independent from an outside institution in which they were studying through? A related question was how could we make ePortfolio available to all learners, irrespective of the institution they were studying with, which was part of one of the goals of the funding proposal. It also meant we could offer a platform for institutions without the challenge that they would have of managing or hosting the installation. And then another question was how could we ensure the ePortfolio was available for learners beyond the time they spent studying at a particular institution, we really hadn't given a lot of thought originally to what might happen to the portfolio beyond an institutional installation of one form or another. But clearly, for the goal that we had in mind, we wanted this to carry with the learner for life. 00:12:00.605 --> 00:12:11.794 So MyPortfolio was a solution to allow learners to also connect with one another across institutions in the manner in which I was describing as a social networking platform. 00:12:12.210 --> 00:12:42.044 I think it would be fair to say that we didn't really end up being very successful with that because partly other tools came along to support that social side of learning. The other aspect to the social networking was we always envisaged the opportunity for group or team-based portfolios. So there was an environment there in which members of the team could communicate and reflect in producing the group portfolio. 00:12:42.465 --> 00:12:48.014 That's still an area which is

underutilised, in my view, in terms of portfolio use. 00:12:48.960 --> 00:13:34.725 But it certainly has become more commonplace, and I've definitely heard it asked for more. Already very early on. There was Scotland's Royal College Barony Campus that had already used group portfolios quite successfully. Then also in the UK, a university used it to document student work, and most recently Dublin City University, in particular, is putting more and more focus on those group portfolios, group interactions, capturing that also in the portfolio to make those authentic learning tasks, but I also know from other institutions that do want to have that capability available and make use of what we offer in Mahara to support those collaborations with the students. 00:13:34.759 --> 00:14:25.159 The Mark, a few years later, you had said in 2014, so that was two years prior to Dublin City University, coming on board with Mahara, you moved to Ireland, became the Inaugural Professor of Digital Learning, and also the Director of the National Institute of Digital Learning at Dublin City University, and in Mahara Hui Online, you take us through the whirlwind of going from one portfolio platform trial to another to finally leading you to Mahara, mainly through the project team. Others than you having selected the platform, and of course Lisa Donaldson being influential in that. The first podcast episode is with her because that story of taking 6,000 learners online with a portfolio just within six weeks is one to tell. 00:14:25.669 --> 00:14:47.389 Looking at it from your perspective, what were the driving forces behind Dublin City University deciding we need a portfolio? Was it the same values that you had for the Mahara project, or were there also other elements that you and the team at the Teaching Enhancement Unit considered? 00:14:47.440 --> 00:15:44.710 Well, at DCU, we were fortunate to have a visionary university president who actively promoted the potential of ePortfolio and was influential in embedding them as part of a new institutional strategy alongside the development of six university-wide graduate attributes. These attributes were known as Generation 21. We actually had a lot of top-down pressure on us to select an portfolio platform after, as you described, two failed pilots. So we actually had a unique challenge, which was mitigating the risks of ePortfolio being perceived as a top-down driven innovation with limited grassroots buy-in from faculty staff. A related challenge was to manage up the risks of over-promising and under-delivering in terms of successful ePortfolio implementation. 00:15:45.317 --> 00:16:07.726 While the number of active users was important in sort of institutional reporting, I was acutely aware that the figure wasn't always necessarily a good proxy for the manner in which ePortfolio were being fully embedded and ultimately being used to transform the student learning experience. So numbers alone don't tell the full story. 00:16:08.460 --> 00:16:33.254 The truth is that Generation 21 was driven by the goal of enhancing students' employability through a set of transversal skills, rather than promoting specific discipline goals or programme level learning outcomes. The transversal skills didn't really live in the academic heartland, and an ePortfolio by itself wasn't going to change that. 00:16:33.615 --> 00:16:35.475 This was going to be a slow burner. 00:16:36.306 --> 00:17:15.080 But at the programme level, ePortfolios were more sticky and successful in supporting both module and programme-wide assessment, irrespective of Generation 21. Individual faculty and a handful of programme teams saw the potential and really drove the uptake of ePortfolio, especially in teacher education. It's notable that Generation 21, the graduate attributes, no longer exist in the DCU discourse. It was always going to be a hard job using a technology platform to embed those transversal skills in the learning culture across the institution. 00:17:15.420 --> 00:17:50.775 But without the original driver and high-level institutional support, it's questionable whether ePortfolio would have become such a key feature of the core DCU tool set. Thanks to the institutional work at the level that Mark and Lisa, particularly Lisa, led, Mahara found a more organic role at the key face of those teaching modules and at the programme level. So it's fair to say that aligning ePortfolio with assessment practice was crucial to achieving this uptake. 00:17:51.519 --> 00:18:42.549 I noted that you mentioned programme level assessment, which came out of the Netherlands, so that we are looking at assessment differently and not just at the individual activity or course level, but really across an entire programme, and portfolios lend themselves very well to that approach. The leadership of an organisation does need to stand behind it and need to also make that space and the time available for staff, lecturers, and everybody involved to make that switch because that's not just changing from a paper-based multiple choice test to an online-based multiple choice test. So I imagine you've had lots and lots of conversations with the teaching faculty and also Lisa running heaps of workshops in order to bring everybody on board, 00:18:43.519 --> 00:19:38.089 Yes, I don't think anyone involved in this area would underestimate the challenge of getting faculty teams talking to one another and sharing what they do in their individual modules. Sadly, it's not something that's common, dare I say it, and you have to look for where the opportunities arise. So, in my experience, one of the best opportunities is when a programme goes through a formal review process. That provides a framework with which conversations can take place about assessment, the types of assessment, duplication of assessment, and the relevance of the learning outcomes, whether or not they align to graduate attributes of some form because not all

programmes use the language of graduate attributes, and some more contribute to discipline-based requirements. 00:19:38.299 --> 00:19:52.460 But you have to look for where there are those opportunities for those conversations and usually find some allies in a leadership role, hopefully, within the programme that can really work with the colleagues. 00:19:49.460 --> 00:19:56.210 So it's not something that's being done to them, but being done with them. 00:19:56.240 --> 00:20:04.640 Yeah, DCU has had lots and lots of success with portfolios because well over 100 programs are using it. 00:20:04.640 --> 00:20:48.349 At the 10th anniversary event at the start of October 2026, the team launched two case study volumes, one specifically from DCU and another one involving other portfolio community members. Lisa Donaldson had also published volumes with case studies from DCU, and again also wider community base. Your team had published 'The learning portfolio: A game of snakes and ladders' publication that is a literature review of, in particular, learning portfolios, so focusing on the lifelong learning aspect of portfolios, which is widely cited and used because it's a fantastic and small publication that is freely available for everybody to engage with. 00:20:48.819 --> 00:21:12.730 So, with all that work that had been done over the years and the success at DCU, from your perspective of dealing more with management, administration, and not being on the coal phase of the implementation of portfolios, why do you feel like that portfolios at many institutions are still only very niche? 00:21:14.039 --> 00:21:34.130 Yeah, well, that's a really great question because, as you say, despite great case studies and examples of good practice, the successful institution-wide adoption of ePortfolio as a really core feature of the learning experience remains very rare. I don't think there's a single magic bullet answer to the question [laughs]. 00:21:34.309 --> 00:21:37.130 Yeah, I was hoping for a revelation on a Wednesday afternoon. 00:21:37.599 --> 00:21:56.740 However, I do think that having the right leadership is important, as well as having the right drivers. It's important to understand that ePortfolio can serve many different purposes, and it helps to be clear about your drivers or intentions when you start. 00:21:51.789 --> 00:22:01.855 The DCU example shows the value of not sticking rigidly to the original institutional driver. 00:22:01.855 --> 00:22:19.194 In my experience, top-down driven innovations are almost doomed to fail. So there's a lot to be said for supporting more locally based initiatives where the uptake can grow quite organically, as happened at DCU. 00:22:14.634 --> 00:22:31.180 Actually, I really prefer to call that adoption strategy as middle out innovation, as there needs to be a link between the local level and then the wider institutional support, resourcing, and infrastructure. 00:22:31.299 --> 00:22:32.289 Both are needed. 00:22:32.630 --> 00:23:07.565 Of course, one of the biggest obstacles to institutional-wide implementation is the traditional culture of assessment. We need to be honest about the fact that much of our assessment does not follow contemporary best practice, where learners have opportunities to critically reflect and produce authentic solutions to real-world problems. It's still much easier, sadly, and less time-consuming to produce multi-response quizzes and to set traditional examinations, especially in the age of Gen AI. 00:23:08.194 --> 00:23:34.549 It's not easy to change assessment practice away from assessment of learning towards more assessment for learning, as it really strikes at the core of what people believe is good teaching and learning, and the purpose of education. So, in my experience, when ePortfolio meets the traditional culture of assessment without some pedagogically led intervention, tradition wins. 00:23:35.299 --> 00:23:55.210 Because it's also easier. It's proven. It has been accredited. Whereas portfolios do take somebody to look at the curriculum and see how can we transform it so that we can make that assessment for learning and then bring in the methods that come with the portfolio. 00:23:56.529 --> 00:24:26.329 I couldn't put my hand on my heart and tell someone that by incorporating an ePortfolio into their curriculum, it's going to be less work. But on the other hand, the experience will be far more intrinsically rewarding for both the instructor or the teacher and the learner. If the goal is to meet the learning outcomes and produce reflection and the habit of mind of lifelong learning, then it's a no-brainer to do so. 00:24:27.799 --> 00:25:08.339 That is a very good point with the workload, especially if you're looking at programmes that have 100, 200, 400 students. Somebody needs to read the reflections and also give feedback on it. Do you involve peers and so on? And one of the sessions that I do still want to organise at some point is we are thinking of 100, 500 students, maybe, but what about the very large open university courses, like they are at Unisa, the University of South Africa, where Mpho-Entle Modise, who is a professor and had co-edited a book last year on the resilience of portfolios has 14,000 students in a course. 00:25:09.029 --> 00:25:23.839 So if we as community can put our heads together and see what are some possibilities to put portfolio practices in place and trial in such massive learning settings, then that is also one big challenge for us. 00:25:24.890 --> 00:25:25.279 Indeed. 00:25:26.480 --> 00:25:39.289 Now, Mark, you've been involved with portfolios for at least 20 years. If you look back, what are some lessons that you have learned or wished maybe you didn't have to learn? 00:25:40.640 --> 00:26:18.964 I tend to think in threes, so let me just give you three lessons that spring to mind. I've touched on the first one, which is that ePortfolio can mean different things to different

people. Both educators and learners don't always understand the different purposes or the many different faces of ePortfolio. While the learning portfolio is not mutually exclusive from an assessment portfolio or a showcase portfolio, the tendency is for one form or feature to dominate over another. So clarity of purpose is really important without constraining other uses. 00:26:19.380 --> 00:26:32.160 The second lesson that springs to mind is to repeat an earlier observation, having an institutional leadership or an ePortfolio champion is crucial. 00:26:27.839 --> 00:26:37.529 Part of the role is to share best practice and develop an internal community of practice. 00:26:37.529 --> 00:26:58.994 The person also serves a crucial link to the wider ePortfolio community, as I think Lisa talks about in the podcast that you had with her. It also helps if key staff, instructors, teachers also personally model ePortfolio in their own professional learning and roles. That's less common. 00:26:59.559 --> 00:27:53.529 The last lesson would be that ePortfolio are arguably most effective, I say arguably because this somewhat cuts across that lifelong learning portfolio, but I'll say arguably most effective at the institutional level when they're fully embedded to support programme-wide assessment and critical reflection across a student's learning journey because they are also involved outside of the programme in other aspects of learning within their institution. It helps if the programme-wide assessment allows learners to demonstrate how they do meet with the evidence any professional or discipline-based requirements or graduate attributes, as I referred to earlier. The alignment between assessment and meeting graduate attributes or programme learning outcomes adds greater coherence to the learner's overall experience. 00:27:54.579 --> 00:28:18.269 Mark, could it also be that implementing a portfolio initially on the institution level is beneficial because that way the learners get scaffolded into the practice? They are becoming familiar with reflection, feedback, and doing that on a regular basis so that once they are then familiar with it, they can later on use it in their own lives. 00:28:19.359 --> 00:28:52.944 It's a bit of a truism I found of any technology. If you don't know how to use it, you don't know how to use it. Often the ways that you end up using a technology are not how they were originally envisaged, or you extend the ideas that were originally embedded in the technology. I think it's a very good thing to get people learning early because there is a technical barrier in the skill level to learn how a platform works, and so you have to be willing to get past that. 00:28:49.045 --> 00:28:54.894 Hopefully, that's a relatively seamless experience. 00:28:55.000 --> 00:29:21.174 Certainly, one of the lessons I know from the early development of Mahara is we spent so much of the development funding on the features, and we weren't so concerned about the look and feel. I've learned over the years that look and feel make a big difference to that initial uptake. If something's very clunky and hard to use initially, that's quite a barrier to the goal that you might have in the longer term. 00:29:22.670 --> 00:29:28.519 Yeah, it's always that balance between having a feature-rich platform but also make it easy to use. 00:29:29.900 --> 00:29:35.180 Where do you think the place of the portfolio is in the coming years? 00:29:36.640 --> 00:30:14.815 I don't think the challenges of wider institutional implementation of ePortfolio are unlikely to change. However, the potential benefits of ePortfolio, I believe, have never been greater in the age of Gen AI. With growing concerns about academic integrity and students, putting it bluntly, cheating using Gen AI, a place for learners to document the learning process, the tools they've used in their learning, and the changes to their thinking over time, with evidence along with their critical reflections on learning, is hugely beneficial. 00:30:15.599 --> 00:30:48.045 An ePortfolio can play a role in supporting peer and self-assessment and new approaches such as interactive oral assessments that I know DCU does quite extensively. An ePortfolio is an ideal solution to many of the challenges as well as the opportunities created by GenAI. I'd like to think that we will see a new wave of interest and enthusiasm for the role of ePortfolio in both assessment and the wider goal of supporting lifelong learning. I'm a born optimist. 00:30:49.059 --> 00:31:27.049 Yeah, and I think it comes down to quite a bit of trial and error and seeing what are students doing here. You had said that people use tools in unintended ways, and so same thing with the portfolio, same thing with Gen AI. What is possible? What is not possible? And how do we then integrate things? How do we also make the use of Gen AI a beneficial one? Like, for example, using it as Socratic partner, as reflection partner, and eliciting more of that reflection rather than staying on the summary level. So there are also some positive ways, and not just looking at it from the perspective of that it's going to write the entire portfolio. 00:31:28.250 --> 00:31:33.829 Yes, it would certainly be a sad outcome if a portfolio ended up being written by AI. 00:31:35.440 --> 00:31:48.940 Yeah, would not be a portfolio because the portfolio does not just live from the artefacts, but really very much from that reflection and making the connections between the different learning activities. 00:31:49.869 --> 00:31:59.500 So that then takes us to our last three questions, Mark. The quick answer round. Which words or short phrases do you use to describe portfolio work? 00:32:00.319 --> 00:32:21.349 The phrase that really springs to mind is 'habit of mind'. Critical reflection is at the heart of ePortfolio thinking and is a lifelong learning disposition for promoting the goal of learning how to learn. So it needs to become a habit of mind which ePortfolio just happens to be able to scaffold. 00:32:23.390 --> 00:32:36.410 Now you've already given us a number of lessons that you've learned over the years. Do you have a final tip for learning designers or instructors, lecturers, tutors who create portfolio activities? 00:32:37.599 --> 00:33:01.900 Don't try to graft ePortfolio onto traditional approaches to assessment. Help educators to reimagine their assessment practice, and the benefits of embedding ePortfolio should follow. It's a cliché, I know, but it's really important to identify the educational problem first, rather than see ePortfolio as the solution in search of a problem. 00:33:02.640 --> 00:33:10.500 And what advice do you then have for portfolio authors, for the students, or also the faculty that should be creating their portfolios themselves? 00:33:11.670 --> 00:33:19.140 To offer something true to the original spirit of Mahara, critical reflection doesn't stop in the classroom. 00:33:19.829 --> 00:33:44.829 Consider how you can use an ePortfolio to bridge your formal, non-formal, and importantly informal learning to better holistically reflect you as a person and your evolving identity as a lifelong, life-wide learner. So to extend what I said earlier, make critical reflection and that ePortfolio scaffold a habit for life. 00:33:46.359 --> 00:34:24.170 Thank you so very much, Mark, for the chat today and sharing your opinions on why portfolio practice is important, why it should become a habit of mind, essentially for everybody, not just for students, but also everybody taking that into their professional lives. I really appreciated that you shared with us where you were coming from and why the portfolio and the idea of the portfolio, in particular the lifelong learning portfolio, were so important to you. So thank you so much for the chat today, Mark. 00:34:25.010 --> 00:34:26.900 You're welcome. I've enjoyed the opportunity. 00:34:28.489 --> 00:34:45.230 Now over to our listeners. As you think about your own portfolio work, what resonated most with you today? Share your thoughts on LinkedIn, Bluesky, or Mastodon, and tag me or send me an email. 00:34:39.800 --> 00:34:45.230 This was 'Create. share. 00:34:45.320 --> 00:35:05.789 Engage.' with Professor Dr Mark Brown. Make sure to check out the resources in the episode notes in your podcast app or at podcast.mahara.org. And if you found this valuable, share it with a colleague who would appreciate it too. Our next episode will air in two weeks. 00:35:00.719 --> 00:35:06.119 Until then, create, share, and engage.