Tag: knowledge integration

behaviour changeeducation & learningsystems thinking

Learning fails in bad systems

on August 28, 2017

2348137226_2d6536745e_o_Edits.jpgEnormous energy is spent on developing strategies to accomplish things with comparatively little paid to the systems that they are being deployed in. A good strategy works by design and that means designing systems that improve the likelihood of their success rather than fight against them and this is no truer than in the effort to learn on the job.

 

A simple search of the literature — gray or academic — will find an enormous volume of resources on how to design, implement and support learning for action in organizations. At an individual level, there are countless* articles on personal change, self-improvement, and performance ‘hacks’ that individuals can do to better themselves and supposedly achieve more in what they do.

Psychology and related behavioural sciences have spent inordinate time learning how individuals and organizations change by emphasizing specific behaviours, decision processes, and data that can support action. A close inspection will find that relatively few strategies produce consistent results and this has to do less with execution, skill or topic and more with the system in which these strategies are introduced.

To illustrate this, consider the role of learning in the organization and how our strategies to promote it ultimately fail when our systems are not designed to support it.

Knowledge integration: A case study

Consider the example of attending a conference as a means of learning and integrating knowledge into practice.

Surajit Bhattacharya published a primer for how to get value from conferences in medicine, pointing to tips and strategies that a medical practitioner can take such as arriving a day early (so you’re not groggy), planning out your day, and be social. These are all practical, logical suggestions, yet they are premised upon a number of things that we might call system variables. These include:

  • The amount of control you have over your schedule week-to-week.
  • The availability of transportation and accommodation options that suit your schedule, budget, and preferences.
  • The nature and type of work you do, including the amount of hours and intensity of the work you perform in a typical week. This will determine the amount of energy you have and the readiness to be attentive.
  • The volume of email and other digital communications (e.g., messages and updates via social media, chat, project management platforms) you receive on a daily basis and the nature of those kinds of messages (e.g.urgency and importance).
  • The amount and nature of travel required to both attend the event and the amount you had prior to attending the event.
  • The level of rest you’ve had. Sleep amount, timing, and quality all factor into how much rest you get. Add in the opportunity to engage in an activity like walking, exercise or stretching that one might do and we see a number of factors that could influence learning performance.
  • The setting. The lighting, air quality and air flow, seat arrangement, room acoustics, and access to some natural light are all factors in our ability to attend to and engage with a learning event.
  • The quality and format of the content and its delivery. Speaker quality, preparation, content and overall performance will all contribute to the ability to convey information and engage the audience.
  • Food and drink. Are you eating the kinds of foods and beverages that enable your body’s performance? Do you have access to these foods and drinks? Are they served at times that suit your body?
  • Your level of comfort and skill at engaging strangers. This matters if you’re more introverted, dislike small talk, or are not energized by others.

These are all platform issues: those in which motivation and energy can be channeled to focus on and engage with learning content. The fewer of these factors present the greater the energy expenditure needed on the part of the learner.

Learning within systems

W. Edwards Deming noted that most of the issues of performance in any organization were due to processes and systems (estimated to be up to 85% or more) rather than individual employees. While Deming was referring largely to manufacturing contexts, the same might be said for learning.

Consider our example from earlier about the conference. We’ve already outlined the factors that could contribute to learning at the conference itself, but let’s extend the case further to what happens after the conference. After all, a surgeon, engineer, computer programmer, law clerk, or carpenter isn’t going to practice her or his craft at the conference; they’ll do it when they return to regular work.

Now consider what our attendee encounters after they have made the trip home to apply this newfound learning:

  • A backlog of emails, phone messages and other correspondence that has either been left untouched, scantly attended to, or fully managed. In the first case, the backlog might be high and requires a considerable amount of time and energy to ‘catch up’ on upon return, however at least the learner was fully present to perform the many activities suggested byBhattacharya in the earlier article. In the second case, there is a higher than usual amount to attend to and the learner might have been selectively disengaged from the learning event. In the third, the learner returns to usual life without a backlog but may have sacrificed considerable attention toward the usual correspondence than actually learning.
  • A backlog of meetings. Scheduled meetings, calls or other events that require a co-presence (virtual or physical) that were put off due to travel are now picked up.
  • A backlog of administrative tasks. Submitting receipts and conference expenses, regular accounting or administrative tasks are all things that either was left untouched or, in the case of submitting expenses, unlikely or impossible to do until the trip has returned.
  • Fatigue. Sitting in a conference can be exhausting, particularly because of the conditions of the rooms, the volume of content and the break in the routine of every day (which can be energizing, too). Add in any travel issues that might arise and there is a reasonable chance that a person is not in an optimal state to take what they have been exposed to and apply it.
  • The usual organization processes and structures. Are there are opportunities to reflect upon, discuss, and process what has been learned with others and spaces to apply those lessons directly with appropriate feedback? How often have we been exposed to inspiring or practical content only to find few opportunities to apply it in practice upon our return in enough time before the details of the lessons fade?

It’s not reasonable to expect to have optimal conditions in our work much of the time, if ever. However, as you can see there are a lot of factors that contribute to our capacity to learn and the required energy needed to take what we’ve been exposed to and integrate it into our work. The fewer of these situations in place, the greater the likelihood that the investment in the learning experience will be lost.

An organization or individual requires a platform for learning that includes systems that allow for learners to be at their best and to provide a means for them to take what they learn and apply it — if it’s valuable. Otherwise, why invest in it?

This isn’t to say that no good can come from a conference, but if the main focus is on actual learning and the application of knowledge to the betterment of an organization and individual why would we not invest in the platform to make use of that rather than discarding it.

Rethinking our systems

When I was doing evaluation work in continuing medical education I was amazed to see how often learning events were held at 7 or 8 am. The rationale was that this was often tied to shift changes at hospitals and were the one time of day when most physicians were least likely to have other appointments. This was also the time when physicians were either highly fatigued from a night shift or having battled traffic on their commute to work or were planning the rest of their day ahead — all circumstances when they might be least focused on actually learning.

This choice of time was done for scheduling purposes, not for learning purposes. Yet, the stated purpose of continuing education was to promote learning and its various outcomes. Here, the strategy was to expose medical professionals to necessary, quality content to keep them informed and skilled and doing it at a time that appeared most convenient for all is an example of an idea that had logic to it, but ultimately failed in most regards.

How? If one looked at the evaluation data, typically the results suggested this strategy wasn’t so bad. Most often post-event surveys suggested that the overall ratings were consistently high. Yet a closer look at the data yields some questions.

For example, the questions asked to assess impact were things like: did the presenter speak clearly? or did the presenter provide the content they said they would? In most cases, participants were asked if the speaker arrived on time, presented what they said they would, were intelligible and whether there was a chance the learner might find useful what was presented. It had little to no bearing on whether the content was appropriate, impactful or applied in practice. This is because the system for evaluation was based on a model of knowledge transmission: content is delivered to a person and, assuming the content is good, the lesson is learned.

We know this to be among the weakest forms of moving knowledge to action and certainly not something suited to more complex situations or conditions, particularly in health systems. This is still what prevails.

Design for learning

If you’re seeking to promote learning and create a culture where individuals across an organization can adapt, develop, and grow learning requires much more than simply sending people to conferences, hosting seminars, providing books and other materials or watching some instructional videos. Without a means to integrate and promote that new knowledge as part of a praxis, organizations and individuals alike will continue to get frustrated, lag in their efforts to anticipate and respond to changing conditions and will ultimately fail to achieve anything close to their potential.

Designing for learning is as much about a curriculum as the context for how that curriculum is delivered and how learners are set up to engage with it all in their organizations and everyday lives.

*This is literally the case because the volume of new articles being published daily is so high.

If you’re looking to create learning systems in your organization, visit Cense to explore what it can do for you in shaping your strategy and evaluation to support sustainable, impactful learning for complex conditions. 

Image credit: “Platform” by Martin L is licensed under CC BY 2.0

 

behaviour changebusinessinnovationknowledge translation

The hidden cost of learning & innovation

on February 8, 2016

7887767996_13f27106fa_k

The costs of books, materials, tuition, or conference fees often distort the perception of how much learning costs, creating larger distortions in how we perceive knowledge to benefit us. By looking at what price we pay for integrating knowledge and experience we might re-valuate what we need, what we have and what we pay attention to in our learning and innovation quest. 

A quote paraphrased and attributed to German philosopher Arthur Schopenhauer points to one of the fundamental problems facing books:

Buying books would be a good thing if one could also buy the time to read them in: but as a rule the purchase of books is mistaken for the appropriation of their contents.

Schopenhauer passed away in 1860 when the book was the dominant media form of codified knowledge and the availability of books was limited. This was before radio, television, the Internet and the confluence of it all in today’s modern mediascape from Amazon to the iPhone and beyond.

Schopenhauer exposes the fallacy of thought that links having access to information to knowledge. This fallacy underpins the major challenges facing our learning culture today: quantity of information vs quality of integration.

Learning time

Consider something like a conference or seminar. How often have you attended a talk or workshop and been moved by what you heard and saw, took furious notes, and walked out of the room vowing to make a big change based on what you just experienced? And then what happened? My guess is that the world outside that workshop or conference looked a lot different than it appeared in it. You had emails piled up, phone messages to return, colleagues to convince, resources to marshall, patterns to break and so on.

Among the simple reasons is that we do not protect the time and resources required to actually learn and to integrate that knowledge into what we do. As a result, we mistakenly look at the volume of ‘things’ we expose ourselves to for learning outcomes.

One solution is to embrace what consultant, writer and blogger Sarah Van Bargen calls “intentional ignorance“. This approach involves turning away from the ongoing stream of data and accepting that there are things we won’t know and that we’ll just miss. Van Bargen isn’t calling for a complete shutting of the door, rather something akin to an information sabbatical or what some might call digital sabbath. Sabbath and sabbatical share the Latin root sabbatum, which means “to rest”.

Rebecca Rosen who writes on work and business for The Atlantic argues we don’t need a digital sabbath, we need more time. Rosen’s piece points to a number of trends that are suggesting the way we work is that we’re producing more, more often and doing it more throughout the day. The problem is not about more, it’s about less. It’s also about different.

Time, by design

One of the challenges is our relationship to time in the first place and the forward orientation we have to our work. We humans are designed to look forward so it is not a surprise that we engineer our lives and organizations to do the same. Sensemaking is a process that orients our gaze to the future by looking at both the past and the present, but also by taking time to look at what we have before we consider what else we need. It helps reduce or at least manage complex information to enable actionable understanding of what data is telling us by putting it into proper context. This can’t be done by automation.

It takes time.

It means….

….setting aside time to look at the data and discuss it with those who are affected by it, who helped generate it, and are close to the action;

….taking time to gather the right kind of information, that is context-rich, measures things that have meaning and does so with appropriate scope and precision;

….understanding your enterprises’ purpose(s) and designing programs to meet such purposes, perhaps dynamically through things like developmental evaluation models and developmental design;

….create organizational incentives and protections for people to integrate what they know into their jobs and roles and to create organizations that are adaptive enough to absorb, integrate and transform based on this learning — becoming a true learning organization.

By changing the practices within an organization we can start shifting the way we learn and increase the likelihood of learning taking place.

Buying time

Imagine buying both the book and the time to read the book and think about it. Imagine sending people on courses and then giving them the tools and opportunity to try the lessons (the good ones at least) in practice within the context of the organization. If learning is really a priority, what kind of time is given to people to share what they know, listen to others, and collectively make sense of what it means and how it influences strategy?

What we might find is that we do less. We buy less. We attend less. We subscribe to less. Yet, we absorb more and share more and do more as a result.

The cost of learning then shifts — maybe even to less than we spend now — but what it means is that we factor in time not just product in our learning and knowledge production activities.

This can happen and it happens through design.

CreateYourFuture

Photo credit by Tim Sackton used under Creative Commons License via Flickr.

Abraham Lincoln quote image from TheQuotepedia.

complexityinnovationsocial innovation

The Ecology of Innovation: Part 2 – Language

on October 2, 2015
Idea Factories or ecologies of innovation?

Idea Factories or ecologies of innovation?

Although Innovation is about producing value through doing something new or different than before, the concept is far from simple when applied in practice by individuals and institutions. This second in a series of articles on innovation ecology looks at the way we speak of innovation and how what we talk about new ideas and discovery shapes what we do about it. 

“Language can be a way of hiding your thoughts and preventing communication” – Abraham Maslow

Innovation is one of the few concepts that offers little benefit contemplated in the abstract. We innovate on specific things with an eye to application, maybe even scaling that idea broadly. Humans innovate because the status quo is no longer satisfying, is unacceptable or has changed so we strive to come up with new ways of doing things, novel processes and tools to make the current situation a preferred one.

Thus, we are designers seeking our client, customer and creation through innovation and we do this through our words and actions — our language. Indeed, if one agrees with Marty Neumeier‘s assertion that design is the discipline of innovation and Greg Van Alystne & Bob Logan’s definition of design as “creation for reproduction” then our language of innovation is critical to ensuring that we design products and services that have the potential to reproduce beyond an idea.

Language matters in innovation.

To illustrate, lets look at how language manifests itself in the communication of ideas using an example from public health. In a paper entitled Knowledge integration: Conceptualizing communications in cancer control systems I co-authored with my colleagues Allan Best and Bob Hiatt, we looked at the way language was used within a deep and broad field like cancer control in shaping communications. This was not merely an academic exercise, but served to illustrate the values, practices and structures that are put in place to support communicating concepts and serves to illustrate how innovations are communicated.

Innovation as product

What we found was that there are three generations of cancer communications defined by their language and the practices and policies that are manifested in or representative of that language. The first generation of terms were traced up to the 1990’s and were characterized by viewing knowledge as a product. Indeed, the term knowledge products can be traced back to this period. Other key characteristics of this period include:

  • The terminology used to describe communications included the terms diffusion, dissemination, knowledge transfer, and knowledge uptake.
  • Focus on the handoff between knowledge ‘producers’ and knowledge (or research) ‘users’. These two groups were distinct and separate from one another
  • The degree of use is a function of effective packaging and presentation presuming the content is of high quality.

The language of this first generation makes the assumption that the ideas are independent of the context in which they are to be used or where they were generated. The communication represented in this generation of models relies on expertise and recognition of this. But what happens when expertise is not recognized? Or where expertise isn’t even possible? This is a situation we are increasingly seeing as we face new, complex challenges that require mass collaboration and innovation, something the Drucker Forum suggests represents the end of expertise.

Innovation as a contextual process

From the early and mid-1990’s through to the present we’ve seen a major shift from viewing knowledge or innovation as a product to that of a dynamic process where expertise resides in multiple places and sources and networks are valued as much as institutions or individuals. Some of the characteristics of this generation are:

  • Knowledge and good ideas come from multiple sources, not just recognized experts or leaders
  • Social relationships media what is generated and how it is communicated (and to whom)
  • Innovation is highly context-dependent
  • The degree of use of ideas or knowledge is a function of having strong, effective relationships and processes.

What happens when the context is changing consistently? What happens when the networks are dynamic and often unknown?

Systems-embedded innovation

What the paper argues is that we are seeing a shift toward more systems-oriented approaches to communication and that is represented in the term knowledge integration. A systems-oriented model views the design of knowledge structures as an integral to the support of effective innovation by embedding the activities of innovation — learning, discovery, and communication — within systems like institutions, networks, cultures and policies. This model also recognizes the following:

  • Both explicit and implicit knowledge is recognized and must be made visible and woven into policy making and practice decisions
  • Relationships are mediated through a cycle of innovation and must be understood as a system
  • The degree of integration of policies, practices and processes within a system is what determines the degree of use of an idea or innovation.

The language of integration suggests there is some systems-level plan to take the diverse aspects within a set of activities and connect, coordinate and, to some degree, manage to ensure that knowledge is effectively used.

Talking innovation

What makes language such a critical key to understanding innovation ecologies is that the way in which we speak about something is an indication of what we believe about something and how we act. As the quote from psychologist Abraham Maslow suggests above, language can also be used to hide things.

One example of this is in the realm of social innovation, where ideas are meant to be generated through social means for social benefit. This process can be organized many different ways, but it is almost never exclusively top-down, expert-driven. Yet, when we look at the language used to discuss social innovation, we see terms like dissemination regularly used. Examples from research, practice and connecting the two to inform policy all illustrate that the language of one generation continues to be used as new ones dawn.  This is to be expected as the changes in language of one generation never fully supplants that of previous generations — at least not initially. Because of that, we need to be careful about what we say and how we say it to ensure that our intentions are reflected in our practice and our language. Without conscious awareness of what we say and what those words mean there is a risk that our quest to create true innovation ecosystems, ones where innovation is truly systems-embedded and knowledge is integrated we unwittingly create expectations and practices rooted in other models.

If we wish to walk the walk of innovation at a systems level, we need to talk the talk.

Tips and Tricks

Organizational mindfulness is a key quality and practice that embeds reflective practice and sensemaking into the organization. By cultivating practices that regularly check-in and examine the language and actions of an organization in reference to its goals, processes and outcomes. A recent article by Vogus and Sutcliffe (2012) (PDF) provides some guidance on how this can be understood.

Develop your sensemaking capacity by introducing space at regular meetings that bring together actors from different areas within an organization or network to introduce ideas, insights and observations and process what these mean with respect to what’s happened, what is happening and where its taking the group.

Some key references include: 

Best, A., Hiatt, R. A., & Norman, C. D. (2008). Knowledge integration: Conceptualizing communications in cancer control systems. Patient Education and Counseling, 71(3), 319–327. http://doi.org/10.1016/j.pec.2008.02.013

Best, A., Terpstra, J. L., Moor, G., Riley, B., Norman, C. D., & Glasgow, R. E. (2009). Building knowledge integration systems for evidence‐informed decisions. Journal of Health Organization and Management, 23(6), 627–641. http://doi.org/10.1108/14777260911001644

Vogus, T. J., & Sutcliffe, K. M. (2012). Organizational Mindfulness and Mindful Organizing: A Reconciliation and Path Forward. Academy of Management Learning & Education, 11(4), 722–735. http://doi.org/10.5465/amle.2011.0002C

Weick, K. E., Sutcliffe, K. M., & Obstfeld, D. (2005). Organizing and the Process of Sensemaking. Organization Science, 16(4), 409–421. http://doi.org/10.1287/orsc.1050.0133

*** If you’re interested in applying these principles to your organization and want assistance in designing a process to support that activity, contact Cense Research + Design.

education & learningknowledge translationpsychologysystems thinking

Bullying, the market for education and the damaged quest for learning

on September 11, 2014
Dark classroom, light minds

Dark classroom, light minds

A recent study found looked into the experience of cyberbullying by university professors at the hands of their students. This disturbing phenomenon points to much larger issues beyond mental health promotion and calls into question many of the assumptions we have about the systems we’ve designed to foster education and what it means to be a learner at university. 

The university is one of our oldest cultural institutions and its instructors are considered to have among societies most respected jobs, even if not always well compensated. In the past, students often approached their professors with a mixed sense of wonder, respect, curiosity and fear and that, in healthy situations, was reciprocated by faculty to create a space where people could explore ideas, learn, and challenge themselves and others to grow. That relationship has started to change as evidenced by the rise of cyberbullying in the classroom.

A recent article in Macleans Magazine looked at the changing state of the post-secondary classroom and the role of cyberbullying. Only this was not about student victims, but students as the perpetrators against their professors. The effects of cyberbullying are crippling and professors are bearing the burden of having hundreds of eyes watching them, writing about them and writing ‘consumer reviews’ about them in anonymous and sometimes unflattering, inflammatory and questionable terms on sites like RateMyProfessor.com .

Researchers at the University of California, Riverside found that as students age the incidence of face-to-face bullying decreases and cyberbullying increases, which might partly explain why we’re seeing this in university settings when face-to-face bullying goes subterranean. Yet, the notion that professors that are getting bullied by their students belies some other issues that require further investigation, namely those related to the nature of education and the role of students-as-consumers.

Consuming knowledge, producing expectations

If you pay for something, should you not expected to get something rather specific for that experience or product? Aside from some rare experiences of profane/profound personal challenge/punishment like Tough Mudder and its peers or dental work, there are few things we willingly pay for that we don’t derive pleasure from or achieve a very specific (anticipated) outcome.

Education is problematic because we might not know what we’ll get from it going in, what kind of experiences or ideas will emerge, and how our relationship to those experiences will change us. That is its great gift.

Many of us have had profound life changes because of something we experienced through our education and writing as one who has completed four different degree programs and a post-doc I can confidently say that I didn’t receive a lot of what I expected in any of those programs and I am a better person for it. Indeed, if I go to a specific learning event (aside from those focused on a specific technique or technology) I am disappointed if I actually come away with exactly what I expected.

That is part of the point. We don’t know what we don’t know.

But when you start viewing education as a thing that resembles any other market-driven product or services, you begin to focus on learning as a consumable good and your students as customers. In following this line of thought, it makes some sense to focus the delivery of this product on the desires of the consumer.

Increasingly, teachers (of various stripes) are being asked to consider a range of student-related variables in their education. Things like learning styles and preferences are now being woven into classroom instruction and students have come to learn to expect and are increasingly demanding to be taught in ways that match their unique learning preferences and styles. While there is reason to imagine that this approach is useful in stimulating engagement of students in the lessons, there is increasing evidence much of it does little to enhance actual learning. Many of the life lessons we’ve gained that shape what we do and who we are were not delivered in the manner of our choosing, conformed with our preferences and were not desired, expected or enjoyed in the moment. We risk confusing enjoyment with learning; they can be aligned but one isn’t necessary for the other to take place.

However, when we are viewing education from a consumer model, the specific outcomes become part of the contract. If I come to get a degree in X because I believe that the job market demands the skills and knowledge that X brings and I am paying tens of thousands of dollars and spending four or more years acquiring X then I feel entitled to expect all the benefits that X brings. Further, I expect that my journey to acquiring X will be enjoyable, because why would I spend more money than I’ve ever seen on something I don’t enjoy.

Particularly when that is money I don’t have.

A debt to pay

In Canada and the United States, student debt rates have dramatically increased. The Canadian Federation of Students note that Canadian’s attending post-secondary education now owe more than $15B to the Canadian federal government (PDF) as part of their student loan program, a number that doesn’t include debt accumulated from borrowing from banks, family, credit cards and other means. In Canada’s largest province, Ontario, the rate of graduate employment has decreased since 2001 and the overall youth unemployment rate continues to be the highest, despite the province having one of the most educated youth population in the country (and arguably, the world). And while Ontario universities continue to promote the fact that education is a better pathway to success, it is a hard pill for many students to swallow when many can’t apply what they trained for and paid for after they graduate.

Satirist John Oliver has an informative, humorous and distressing take on student debt and the state of consumer-oriented education for those who want to learn more.

None of these reasons are excuses for cyberbullying, but it does give a more complicated picture of those that might feel they are entitled to bully others and their reasoning behind it.

What we are seeing is a systems change in the way education is being produced, consumed and experienced. Even the mere fact that we can now reasonably use the language of consumerism to speak to something like education should give us pause and concern. I’ve been involved in post-secondary education for nearly 20 years and there has always been students who simply wanted the ‘piece of paper’ (degree) as a stepping stone to a job and little more than that from their time at school. They were willing to do the work — often the minimum possible — to graduate, but they knew they had to put the effort in to be successful. There was never an expectation that one was entitled to anything from going to school, although that might be changing.

Market identities and education systems

Belgian psychotherapist Paul Verhaeghe has explored the role of identity in market-based economies in his new book What About Me? In the book, Verhaeghe illustrates how we construct our identities as people drawing on the research that reflects (and often contradicts or obscures) the two major perspectives on personality and identity: the person-as-blank-slate and the person as a reflection of the environment. The former perspective assumes we come into the world as we are while the latter assumes the world makes us who we are and both have enormous amount of moral, cultural and evidentiary baggage attached to them.

What Verhaeghe does is point to the ways in which both have elements of truth to them, but that they are mediated by the manner in which we construct the very questions about who we are and what our purpose is. These questions are (for many cultural, historical, economic and political reasons that he elaborates on) frequently market-based. Thus, who we are is defined by what we do, what we own, what we produce, and how we use such things once out into the world and that the value that come with such ways of defining ourselves is considered self-evident. He makes a disturbing and convincing case when one stops to reflect on the way we think about how we think (metacognition + mindfulness) .

When viewed from the perspective of a market, knowledge and its products soon become the goal and not the journey. Indeed, I’ve even written about this in support of an argument for better research-to-action and knowledge translation. Much of the knowledge-to-action discourse is about viewing knowledge as a product even if the more progressive models also view this as part of a process and even more as part of a system. But it is the last part — the system — that we often give the shortest shrift to in our discussions. What Verhaeghe and others are doing is encouraging us to spend more time thinking about this and the potential outcomes that emerge from this line of thinking.

Unless we are willing to talk more about the systems we create to learn, explore and relate we will continue to support Verhaeghe’s thesis and uphold the conditions for the kind of education-as-a-product thinking that I suspect is contributing to students’ changing behaviour with their professors and creating a climate at universities that is toxic instead of inspiring.

Photo credit: Classroom by Esparta Palma used under Creative Commons License via Flickr. Check out Esparta’s remarkable work here.

behaviour changecomplexitydesign thinkinginnovationpsychology

The Organizational Zombie Resistance Kit

on October 29, 2013
How to thwart a zombie

How to thwart a zombie

Zombies — unaware, semi-conscious, distracted individuals — are all around us and running many of the organizations we work in or with. And just like combatting real zombies there is a need to target the head.

There is much musing about what a zombie apocalypse might look like, but anyone paying attention to what is going on around them might not have to imagine what that looks like as they’d be forgiven for thinking it is already here. Whether its people glued to cellphones while walking/running/biking/driving, asking ‘dumb’ questions immediately following the answer, or scientists lazily allowing junk to pass peer review, we are surrounded by zombie-like behaviour.

As discussed in a previous post, the zombies are already here. A zombie in this context exhibits mindless attention in a manner that restricts awareness and appreciation of one’s immediate context and the larger system to which that behaviour occurs. Zombies are great fodder for horror movies, but lousy companions on the journey of life and even worse problem solvers. Building resistance to them involves more than just aiming for the head, it means aiming for the heart (of an organization). Thankfully, there are methods and tools that can do that and thus, CENSEMaking brings you the Zombie Resistance Kit.

Building resistance to zombies

I am a professional zombie hunter. I do this by helping organizations to be more mindful. A mindful organization is aware of where it sits in the systems it inhabits, connects the current context to its past, and from those places envisions paths to futures not yet realized; it is part psychology, part strategic foresight, and part research and evaluation. How it expresses this knowledge into value is design.

Building a mindful organization — one resistant to zombies — requires inoculation through awareness. There are eight broad areas of attention.

1. Grounding is a process of holding to where you are by first revealing to yourself where that is. It is about locating yourself within the system you are in and connecting to your history. Mindfulness is often seen as being focused on the present moment, but not at the expense of the past. Understanding the path you took to get to the present allows you to see path dependencies and habits and mindfully choose whether such pathways are beneficial and how they relate to the larger system. Surfacing assumptions and system mapping are key methods and tools to aid in the process of grounding an organization.

2.  Attunement is a means of syncing yourself to the environment, your role within it (after having been grounded) and increasing your receptor capacity for sensing and learning. It is about calibrating ones mission, vision, and strategy with the system purposefully and intentionally building your awareness for understanding how harmonious they are for your organization. When attuned to what is going on — literally being tuned into the signals around you — the potential to see and process both strong and weak signals is heightened, increasing sensemaking and sensing capability at the same time. The ability to see the system and understand what it means for who you are and what you do is a terrific means of combating zombie-like thinking.

3. Discovery: Encouraging curiosity and promoting a culture of inquiry is another key means of enhancing awareness. Kids are constantly amazed by the things they see and experience everyday. The world is no less amazing today than it is was when we were kids, but the pressures to act and ‘be’ particular ways can greatly inhibit the natural curiosity that we all have about what is going on around us. Encouraging discovery and asking critical questions about what we find is a means of enhancing overall engagement with the raw materials of our enterprise. It is risky because it might call into question some long-held assumptions that are no longer true, but if people are genuinely supported in asking these questions an organization increases the number of ‘sensors’ it has in it across conditions, roles and sectors generating new, context-ready knowledge that can seed innovation and enhance overall resiliency.

4. Creativity: Application of creative methods of problem finding, framing and solving via design thinking is a means of promoting engagement and seeing systems solutions. Design thinking can be a means of creative facilitation that guides mindful development, discovery, synthesis and solution proposals. Encouraging generation of ideas of all types, firsthand research, creation of prototypes, and the opportunity to test these prototypes in practice allow for individuals to claim legitimate ownership of the problem space and the solution space. This ownership is what creates true investment in the work and its outcomes, which is what zombies lack.

5. Strategic Foresight: By envisioning not only what a design can produce in the short-term, but see a future for what is created today into the years ahead, we build commitment to long-term goals. Strategic foresight brings together all of the preceding components to start envisioning what possible futures might look like so that an organization can better prepare for them or even create them. Strategic foresight is a structured means of visualizing possible futures based on current trends, data-driven projections, models and strategic priorities of the organization and connects the present activities to the past and projects possible futures from all of this giving the zombie a reason to stop its relentless blind pursuit of an unaware present goal.

6. Focus: While creative thinking is useful in enhancing divergent perspective taking and seeing new possibilities, focus allows for attendance to the critical path and refinement of strategy to fit the context, desires, capacity and intentions. Of the many futures that a strategic foresight process might produce, focusing the energy on those that are the most beneficial, congruent with goals and desires, and synchronous with the systems that an organization engages is another way to shock mindless thinking out of its zombie-like state. A focus provides a richer experience and something to strive for.

7. Knowledge integration. Introducing possibilities, building a creative culture, enhancing receptor capacity and building a focus is not sustainable if knowledge isn’t integrated throughout the process of moving forward; it is the knowledge practice behind developmental design.  Knowledge integration involves critically examining the organizational structure and culture to observe current knowledge practices. Do you have the right tools? The ability to use those tools effectively and make sense of the findings? Is the system understood and aligned to the purpose and resources available? When your system is aligned and the structures are put into place to work with that alignment knowledge is put to use.

8. Design Cycling: Developmental design is the means of engaging in ongoing evaluation and design simultaneously, while knowledge integration is taking the learning from those products and incorporating it into the DNA of the organization. Design cycling is the process by which this unfolds and iteratively repeats over cycles of innovation. Invariably, organizations tend to drift a little and by framing the innovation process as a cycle it acknowledges that even the best ideas will reach an ebb and flow and require renewal. This cyclical process encourages us to return to the first stage. This is an approach consistent with the Panarchy approach to life cycle development in complex systems. Everything runs its course.  This approach is consistent with a natural systems perspective and a pillar of the work on sustainable development in natural systems.

This model of development and organizational awareness provides balm against zombie-like behaviour. It gets people excited, it produces visible results that can be scrutinized in a transparent way, and it heightens engagement by bringing everyone in an organization into the role of problem framing, finding and solving. It enhances accountability for everyone who are now enlisted as creators, researchers, designers, and sensemakers.

By being more aware and alive we better engage brains rather than use that grey matter as food for zombies.

For more details on using this approach with your organization contact CENSE Research + Design.

Photo credit: From Zombie Walk 2012 SP collection by Gianluca Ramahlo Misiti used under Creative Commons Licence

education & learninginnovationjournalismknowledge translation

Is Knowledge Translation In Health Too Important to Leave to Health Professionals?

on April 24, 2013

Storytelling

Knowledge translation — and its affiliated terms knowledge exchange, knowledge integration and knowledge mobilization — was coined to describe a process of taking what is known into what is done in health across the spectrum of science, practice, policy and  the public’s health. As health issues become more complex due to the intertwining of demographics, technology, science, and cultural transformations the need to better understand evidence and its impact on health has never been higher. Questions remain: has demand met supply? How are the health professions dealing with this equation?

Translating knowledge

The Canadian Institutes of Health Research (CIHR), one of the earliest champions of the concept of knowledge translation in research, define it as:

a dynamic and iterative process that includes synthesis, dissemination, exchange and ethically-sound application of knowledge to improve the health of Canadians (sic), provide more effective health services and products and strengthen the health care system.

These ideas are expanded below:

Synthesis – Synthesis, in this context, means the contextualization and integration of research findings of individual research studies within the larger body of knowledge on the topic. A synthesis must be reproducible and transparent in its methods, using quantitative and/or qualitative methods. It could take the form of a systematic review, follow the methods developed by the Cochrane Collaboration, result from a consensus conference or expert panel or synthesize qualitative or quantitative results. Realist syntheses, narrative syntheses, meta-analyses, meta-syntheses and practice guidelines are all forms of synthesis. Resources related to synthesis are available.

Dissemination – Dissemination involves identifying the appropriate audience and tailoring the message and medium to the audience. Dissemination activities can include such things as summaries for / briefings to stakeholders, educational sessions with patients, practitioners and/or policy makers, engaging knowledge users in developing and executing dissemination/implementation plan, tools creation, and media engagement.

Exchange – The exchange of knowledge refers to the interaction between the knowledge user and the researcher, resulting in mutual learning. According to the Canadian Health Services Research Foundation (CHSRF), the definition of knowledge exchange is “collaborative problem-solving between researchers and decision makers that happens through linkage and exchange. Effective knowledge exchange involves interaction between knowledge users and researchers and results in mutual learning through the process of planning, producing, disseminating, and applying existing or new research in decision-making.”

Ethically-sound application of knowledge – Ethically-sound KT activities for improved health are those that are consistent with ethical principles and norms, social values, as well as legal and other regulatory frameworks – while keeping in mind that principles, values and laws can compete among and between each other at any given point in time. The term application is used to refer to the iterative process by which knowledge is put into practice.

In short, knowledge translation is about taking what we learn and know from evidence, sharing that knowledge with others and assisting them to make useful health choices in practice and policy through KT.

This often involves communicating across contexts, disciplines, and roles between and from scientists, clinicians, policy makers and to the public alike. In a health environment that is increasingly becoming complex, the ability to communicate across boundaries is no longer an advantage, it’s an essential skill. While we may not always have the right language, we can translate meaning through stories.

But if stories are to be effective they need to be valued.

The value of storytelling

I’ve seen health professionals — scientists and clinicians — roll their eyes when you mention storytelling in a work context. It is as if the only legitimate role for stories is to communicate with children (which University of Alberta researchers are exploring as a tool for sharing health knowledge with parents). Yet, it is through stories that most people share what they know in every other context; why would it be different in health?

Perhaps it is the connotation that stories are ‘made up’ like children’s bedtime tales, but one need only look to journalism to find that we’ve been making ‘stories’ a central part of our life every day. We listen to drive-time radio for stories about the traffic conditions, we watch, download and listen to news stories filed by professional journalists and citizen bloggers alike on mainstream media, Twitter, YouTube, Facebook along with myriad sources across the web. Last week we were glued to various sources to learn stories — some of them false — and create stories about the events of the Boston Marathon bombings.

Stories are what conveys multiple information threads and puts it in a coherent context.

Stories are coherence engines.

Valuing knowledge translation

If knowledge translation is important then it should be reflected in research priorities and evidence for its impact on the system across different disciplines. Dr Shannon Scott and her U of A team recently conducted a systematic review of knowledge translation strategies in the allied health professions and found that the field was full of low quality studies that made it impossible to make firm statements on which methods were best among them . That team has recently proposed a systematic review looking at how the arts and visual methods can further contribute to KT in practice, although it likely the same issue with methodological quality might come into play here, too.

What she and her team are doing is looking at the process of sharing stories and, from a research perspective, sharing stories appears to not have been worth investing in scientifically. At least, not enough to generate a lot of studies and good evidence.

One could argue that knowledge translation is still new and that it takes time to generate such evidence. That is partly true, but it is also an easy prop for those who want to avoid the messiness that comes with communication (and its problematic research context), learning from others, and creating more equitable information spaces, which is what knowledge translation ultimately does. Knowledge translation has also been in use for almost 20 years so in that time — even with the most dismal assessment of the length of time it takes to put knowledge into practice — we should be seeing some decent research published.

KT is fundamentally about sharing. Journalists’ are rewarded for sharing — the more they share and the more people who they share with (as measured by readers, listeners, viewers etc..) the more successful they are in their work. Teachers are rewarded for sharing because that means that they are teaching people. Librarians are rewarded for sharing because that means people are checking out books and using the resources in their library.

We don’t apply the same standard to academic research, even though we have some crude metrics to measure reach and impact,  and there is roughly no metric for the degree to which clinicians share among themselves. Maybe this needs to change.

I have scientific colleagues who are fierce in the face of their most strident academic critics and have delivered keynotes to auditoriums filled with researchers that are nearly paralyzed in the face of speaking to the public. This is not fear of public speaking, its fear of speaking to the public.

Should they be? I don’t think speaking to the public should be expected to be enjoyable for everyone, but neither are doing statistical calculations, completing ethics applications, or presenting posters at conferences, but we still expect scientists to do that. We still expect nurses, doctors, psychologists, medical technicians and social workers to traverse complex social problems to talk to their patients in an open and honest way.

Why is it when scientists are speaking to policy makers, clinicians to scientists, policy makers to the public, or any professional to another from another discipline, speciality or division we decide its not critical for them to make the effort?

Why don’t we do the research to support it? 

Why is it OK not to do KT because its uncomfortable, awkward, difficult or confusing?

Declining interest, rising demand

It is perhaps for reasons like this that knowledge translation is so poorly understood and taken up as a focus for research. Looking at Google NGram data (which tracks mention of specific topics in books and publications) we see a steady rise in citations until about 2003 followed by a levelling off. Keep in mind that the leveling begins before social media became known. In the years after Twitter, Facebook and YouTube — arguably the most powerful communications media we have for doing knowledge translation widely (but perhaps not deeply) — there is roughly no sharp increase.

Below are the citations for the terms knowledge translation, knowledge exchange, and knowledge integration  from 1996 (when the Web first started gaining wide use beyond academia and the military) and 2008, the latest year for which there is available data. Note that the numbers reflect general mentions as a percentage of overall terms, so they are relative, not absolute values.

Figure 1: Google NGram Data for KT, KE & KI: 1996-2008

Knowledge Translation, Exchange & Integration NGram

Is there so much other stuff to talk about in 2013 that the relative importance of knowledge translation is diminished?

A look at Google Trend data using the same terms finds that not only are these concepts not growing, their mention is actually shrinking.

Looking at the three terms we see that all three concepts have declined over time. During these years — 2004-2013 — we saw not only the birth of social media, but the rise of Internet-enabled handheld devices to allow knowledge to be shared anywhere there is a data signal. We now have apps and nearly all of the Internets resources in our pockets and we are seeing a decline in the use of these terms.

Figure 2: Google Trend Data for KT, KE & KI: 1996-2013

Knowledge Term Trends

Where to?

So to review: We have a body of evidence in KT that is problematic and incomplete at the same time we have a decrease in use of the terms, while at the very same time we have a sharp rise in available tools and technologies to share information quickly and a continued, steady demand for more information to make decisions for health providers, patients, policy makers and insurers.

Yes, the data presented here are not perfect. But does it not make sense that there should at least be some trend upward if knowledge translation is valued? Should we not see some shift to more research, better research evidence, and greater interest given the tools and scope of communications we have through social media?

This begs the question: is knowledge translation in health too important to leave to health professionals? 

In future posts this question will be looked at in greater depth. Stay tuned.

* Blog has been updated since original post

education & learningevaluationinnovationscience & technologysystems thinking

The Knowledge Metric in Education

on January 9, 2013

EducationHead

Higher education is asking itself some big questions and making substantive changes to the way it sees itself and produces value for society. Education is increasingly being rationalized, which calls into question the metrics that are being used to judge how resources should be allocated. In a previous post, I looked at the jobs metric. Now, it’s time to look at the knowledge metric.

Just the facts

Education writer and teacher Will Richardson‘s TED Book Why School is a provocative read for those connected to teaching or just interested in schooling. While it focuses largely on grade school, the issues are the same for universities and colleges particularly as the primary and secondary students of today are tomorrow’s graduate and professional learners. Richardson questions the role of the school as institution in its current form suggesting that if the status quo — one characterized an information delivery warehouse — is maintained there is little need for schools to exist at all. Yet, if the education within schools is focused on asking better questions and learning when to apply knowledge, not just what knowledge to apply, there is hope.

The current trend in school reform is towards Common Core Standards, which emphasizes specific forms of knowledge, ‘facts’ and asks that students be able to recall such content when required. Under this model, the role of the teacher is one of content manager and facilitator rather than guide or mentor and students are prepped for the tests of their knowledge (memory) rather than be asked to demonstrate its application to anything outside of the test.  It is this model that many proponents of online education embrace, because the Internet is a fabulous content delivery system and education can be literally programmed and delivered to students directly without the ‘noise’ that teachers introduce to the signal. Under this model, educational content can be delivered cheaply and widely to support uniform intended effects among learners.

Richardson argues for reforming schools to something closer to the alternative model that was advanced by educational reformer and philosopher John Dewey. Richardson writes:

“In this version of reform, schools and classrooms are seen as nodes in a much larger learning network that expands far beyond local walls. Students are encouraged to connect with others, and to collaborate and create with them on a global scale. It’s not “do your own work,” so much as “do work with others, and make it work that matters.” To paraphrase Tony Wagner, assessments focus less on what students know, and more on what they can do with what they know. And, as Dewey espoused, school is “real life,” not simply a place to take courses, earn grades, amass credits, and compete against others for recognition. There lies the tension.

This second path is simply not as easy to quantify as the first. Developing creativity, persistence, and the skills for patient problem solving, B.S.-detecting, and collaborating may now be more important than knowing the key dates and battles of the Civil War (after all, those answers are just a few taps on our phones away), but they’re all much more difficult to assign a score to. I’m not saying that a foundation of content knowledge isn’t still important. To communicate, function, and reason in the world, students need effective reading and writing skills, as well as a solid foundation in math, science, history, and more. But I’m convinced we must revise the overreaching coursework requirements we place on students — requirements created at a time of scarcity, by the way. And we desperately need to revisit the thinking we’ve developed around assessment that, as Harvard researcher Justin Reich says, “optimizes the measurable at the risk of neglecting the immeasurable.””

Facts vs Problems

The knowledge metric is flawed because it assumes that content solves problems. It also presumes that the curriculum teaches the right knowledge for the right problems and that those problems can be known in advance. Let’s look at these.

One need only look to cigarette smoking as an example of how knowledge alone doesn’t always solve or prevent problems. One would be hard pressed to find anyone over the age of five who doesn’t know that sticking a lit tube of anything in their mouth and sucking on it isn’t at least somewhat unhealthy (and most know it is very unhealthy). An individual’s knowledge of smoking’s effects on physical health may not be complete, but it is often sufficient to inform the decision to quit or not start the unhealthy habit. And yet, citizens in highly educated countries like the United States, Canada and the U.K. smoke more than 1000 cigarettes per year per capita (and over 2700 per capita in places like Russia). These are not countries lacking in information on tobacco and health.

Using students’ ability to recall content makes the presumption that what is contained in a curriculum is what they need to know when they leave their program of study (at least as a start). While it may be somewhat true for students in the humanities and languages, it becomes highly problematic for those in dynamic fields or emergent areas of practice, which is becoming more normal than rare. There is no doubt that a corpus of key concepts, skills and ‘facts’ is useful, but the manner in which this knowledge can and may be applied is changing dramatically. For example, social media has upended communications in ways that very few health professionals are trained for. Journalists are particularly aware of the role that Twitter and related tools have had on their profession.

It also presumes that the content itself is relatively static. Certainly, curriculum renewal is something that most learning institutions engage in, but the primacy of content itself as the driver of education also assumes that the foundation for that knowledge is solid and can be applied today in the manner it was applied yesterday. In dynamic conditions, that isn’t often true. Further, the relevance of knowledge is framed by the problems to which that knowledge is applied. Genetic information, for example, can be incredibly useful when framed against tests that have high confidence, predictability and value to people, yet without such a context it is largely useless to those non-scientists who have it.

Areas of social innovation — which are expanding dramatically in number and scope — illustrate the problem of changing context well. This is a field characterized by problems, problem solving and novelty (which is what innovation is all about). Standard approaches don’t apply easily or at all when we are faced with high levels of novelty. Thinking and re-thinking the problem frame, knowing what to find, where to find it, and the skills to integrate relevant knowledge together is something that is not captured in the knowledge metric. Yet, it is those skills that will lead innovation. Knowledge translation professionals know this and so do knowledge brokers.

Are we designing our educational programming to advance on the kind of design issues of problem framing, finding and solving that our world is facing? Or are we simply taking content that can be obtained through books, the Internet and other materials, repackaging it and creating expensive warehouses of information that take learners out of the world and out of context in the process?

I don’t suggest that universities and continuing education programs stop delivering content, but if knowledge is the metric by which they are judging their success then it behooves educational administrators and funders to justify why they can do it better than other tools. What made sense when content was a rare commodity makes little today when it is overflowing in abundance for little or no cost. Universities and post-graduate training programs have an opportunity to re-imagine education and have the tools to do it in a way that makes learning more powerful and relevant for the 21st century should they choose to change their metrics of success.

Designing education

How might we take the enormous talent trust that exists among university faculty (and their students) who co-locate (physically, virtually or in some combination) in a school and develop the skills to not only address problems of today, but prepare everyone for possible challenges in the future?

How might we integrate what we know, identify the knowledge we need, and create systems to take advantage of the talent and creativity of individuals to make universities, colleges, and post-professional training venues for innovation and inspiration rather than just content delivery vehicles?

What kind of metrics do we need to evaluate this kind of education should we choose to develop it?

These are questions whose answers might yield more learning than those focused on what knowledge students have when they graduate.

___

Image source: Shutterstock.

1 2