When journalist and book author Daniel Pink tweeted the above image the other day it provoked thinking about what real learning means and what it takes to achieve it. We produce enormous amounts of knowledge, yet struggle to put it into use, but we also teach much and learn little because the systems we’ve designed for education and experience don’t match our expressed interest and rhetoric around learning.
In my graduate course on behaviour change I would ask students on the first day why they were taking the class in the first place. Aside from the few students for whom the course was required everyone else was doing it by choice because there were many others to choose from. So why would they choose this one?
The answers would vary, but inevitably I’d hear over and again that students love learning and wanted to understand more about behaviour change, because they were interested in change and some would even say they were good at it and wanted to help others do it.
These are all well-meaning and said in a spirit that I think was honest and true. Except the reality is that it is likely a big, huge lie and one that we all share in its telling.
I would counter with two things:
Loving the idea of learning something new is different than actually seeking out learning opportunities and that most of us love the former, but are not so enthused about the latter;
The only people who regularly welcome change are babies with soiled diapers.
To illustrate the first point I simply ask people to consider the last conference they went to where there were options on what sessions to attend. How many of the sessions did they attend that featured content that confirmed or gently extended what they already knew versus content that was new? If you’re a health promoter doing community engagement work, sessions on Bayesian modelling for epidemics might offer far more learning than a session on working with diversity in communities (particularly if that is what you already do). Even more, how often do people go to sessions from people they know or have already seen speak? Chances are, many.
One could argue that there are subtleties that a conference presentation might offer on a familiar topic that are worth attending and while I would say that has merit, most learning that has impact is uncomfortable at some level. It extends our thinking, challenges our beliefs, or re-arranges our worldview — in ways small and large.
Wanting knowledge and living learning
Many people will say “I love change”, but that is usually in the context that everyone else is changing, not them. When I was the boss and said “things must change” it was very different than when my staff or my boss would say “things must change“. As a behaviour change educator and intervener, I need to be mindful of my own ironies and resistance to change. So should we all.
The same thing goes for knowledge. Academics are famous for ending studies with “more research is needed”. We never seem to have enough knowledge. There are two problems with this idea.
The first is that, in dynamic and evolving environments, we will never have perfect knowledge that fits like a glove, because the contexts are always novel. This isn’t to say that evidence isn’t useful, but ‘good enough’ knowledge might be a more reasonable demand than ‘best evidence’ in many of the situations where complexity is high and so is change. That’s why data gathering techniques like developmental evaluation aren’t attractive to those who need certainty.
But there is another problem with the knowledge quest and that is one of integration. In our efforts to seek more knowledge, are we integrating what we are learning from what we already have? Are we savouring the data we collect, the articles we read, the Tweets and blogs that get forwarded are way?
We quest for more, but should we quest for better?
A newly published paper synthesized research on event horizons on memory and found that shifts in activities around an event — boundaries — can prompt forgetting and recall. We remember transitions between activities, but they also prompt forgetting depending on the mindfulness associated with the act. When we are deluging ourselves with more data, more media, more everything, we are increasing the potential remember rate, but due to the volume of content, I would surmise that we are increasing the forget rate much more. Simply reflect on your high school or undergraduate education and ask yourself if you remember more than you forgot about what you learned.
We are so busy with our search for new knowledge that we interrupt opportunities to learn from what we have.
Serious learning means non-doing
Returning to the tweet from Dan Pink, it’s worthwhile considering what it means to learn and the systems we have in place to facilitate learning. The tweet links to a discussion of how German companies give their employees five days of off-site continuing education each year. This concept of Bildungsurlaub is a leave designed to allow employees to stretch their thinking and integrate something new. Not only is off-site learning important, but the time associated with integrating material is critical.
A read of the literature on innovation and research shows consistently how time off, quiet time, slow time and down time all contribute to discovery. Robert Scott Root-Bernstein’s brilliant Discovering, Jonah Lehrer’s Imagine, or Steven Johnson’s Where Good Ideas Come From are all books that dive deep into creative production and show that great discoveries and innovations come from having time (with limits) to integrate material to learn. Freedom to create, explore and sit and mindfully reflect are all united concepts in the pursuit of good learning. Not everything requires this, but big concepts and bold ideas do from mathematics to science to social science and philosophy.
Yet, at an organizational and systems level, where is the support for this? Even university faculty (the tenured ones at least) who have generous vacations and sabbaticals are finding themselves crunched for time between the fight for one of the ever-fewer grants, increasing numbers of students and teaching demands, and the added push to ensure knowledge is translated. The image of faculty sitting and reading and thinking is truly an imagination. Most of my colleagues in academia do little of this, because they are out of time.
In the corporate and non-profit world this is worse. Every hour and day is to be accounted for. The idea of sending people off to learn and to think seems anathema to productivity, yet research shows incredible powers associated with taking a break and doing less and not more.
Getting serious about learning
To illustrate the scope of the problem, the University of Toronto holds one of the finest academic library systems in the world and has over 11.5 million books and 5.7 million microform materials. It is one university (of many) in one city. Add in the local Toronto public library system, the network of universities and other libraries it is connected to, local and global bookstores and all the content freely available online that is not part of this system and I challenge anyone working in social innovation or public health to say with conviction that there is a lack of knowledge out there on any important topic. Yes, we don’t know it all, but we don’t do nearly enough with what we do know because there is so much.
We will not read it all nor can we hope to synthesize it all, but we can do much with what we have. Just looking at my own personal library of physical books (not including all I have in the digital realm between books and papers) it’s easy to see that I have more than enough knowledge to tackle most of what I am facing in my work. Most of us do. But do we have the wisdom to use it? Do we have the systems — organizations and personal — that allow us to take the time and soak this in, share our ideas with others, and be mindful of the world around us enough to learn, not just consume?
When we spend as much time creating those spaces, places and systems, then we can answer “yes” to the question of whether we’re serious about learning.
I've just spent two stimulating days with a small group of architects, university professors, and creativity researchers, at a beautiful old lakeside estate called Marigold Lodge, in Western Michigan. Our goal: To collect everything we know about how to design spaces that maximize learning and foster creativity. With funding from the Sloan Foundation and from the legendary furniture company Herman Miller (which now owns Marigold Lodge), our task is to write a report that will advise university administrations and architecture firms, to guide how new university buildings are designed.
Keith Sawyer's latest post provides a terrific introduction to a new series coming on the design of learning that I'll be doing on Censemaking in the coming weeks. The importance of the environments -- social and physical -- that support creativity cannot be understated and Dr Sawyer's reflections, if taken seriously by educators and academic administrators, could transform the demands that educational institutions pose on their builders, their teachers and their students (who, by the way, are already asking for better spaces to learn). If you're not familiar with Keith Sawyer's work, look him up and consider reading some of his many outstanding texts on creativity and innovation; they are top-notch.
Earlier this week I has the pleasure of attending talks from Bryan Boyer from the Helsinki Design Lab and learning about the remarkable work they are doing in applying design to government and community life in Finland. While the focus of the audience for the talks was on their application of design thinking, I found myself drawn to the issue of evaluation and the discussion around that when it came up.
One of the points raised was that design teams are often working with constraints that emphasize the designed product, rather than its extended outcome, making evaluation a challenge to adequately resource. Evaluation is not a term that frequents discussion on design, but as the moderator of one talk suggested, maybe it should.
I can’t agree more.
Design and Evaluation: A Natural Partnership
It has puzzled me to no end that we have these emergent fields of practice aimed at social good – social finance and social impact investing, social innovation, social benefit (PDF)– that have little built into their culture to assess what kind of influence they are having beyond the basics. Yet, social innovation is rarely about simple basics, it’s influence is likely far larger, for better or worse.
What is the impact being invested in? What is the new thing being created of value? and what is the benefit and for whom? What else happened because we intervened?
Evaluation is often the last thing to go into a program budget (along with knowledge translation and exchange activities) and the first thing to get cut (along with the aforementioned KTE work) when things go wrong or budgets get tightened. Regrettably, our desire to act supersedes our desire to understand the implication of those actions. It is based on a fundamental idea that we know what we are doing and can predict its outcomes.
Yet, with social innovation, we are often doing things for the first time, or combining known elements into an unknown corpus, or repurposing existing knowledge/skills/tools into new settings and situations. This is the innovation part. Novelty is pervasive and with that comes opportunities for learning as well as the potential for us to good as well as harm.
An Ethical Imperative?
There are reasons beyond product quality and accountability that one should take evaluation and strategic design for social innovation seriously.
Design thinking involves embracing failure (e.g, fail often to succeed sooner is the mantra espoused by product design firm IDEO) as a means of testing ideas and prototyping possible outcomes to generate an ideal fit. This is ideal for ideas and products that can be isolated from their environment safely to measure the variables associated with outcomes, if considered. This works well with benign issues, but can get more problematic when such interventions are aimed at the social sphere.
Unlike technological failures in the lab, innovations involving people do have costs. Clinical intervention trials go through a series of phases — preclinical through five stages to post-testing — to test their impact, gradually and cautiously scaling up with detailed data collection and analysis accompanying each step and its still not perfect. Medical reporter Julia Belluz and I recently discussed this issue with students at the University of Toronto as part of a workshop on evidence and noted that as complexity increases with the subject matter, the ability to rely on controlled studies decreases.
Complexity is typically the space where much of social innovation inhabits.
As the social realm — our communities, organizations and even global enterprises — is our lab, our interventions impact people ‘out of the gate’ and because this occurs in an inherently a complex environment, I argue that the imperative to evaluate and share what is known about what we produce is critical if we are to innovate safely as well as effectively. Alas, we are far from that in social innovation.
Barriers and Opportunities for Evaluation-powered Social Innovation
There are a series of issues that permeate through the social innovation sector in its current form that require addressing if we are to better understand our impact.
Becoming more than “the ideas people”: I heard this phrased used at Bryan Boyer’s talk hosted by the Social Innovation Generation group at MaRS. The moderator for the talk commented on how she had wished she’d taken more interest in statistics in university because they would have helped in assessing some of the impact fo the work done in social innovation. There is a strong push for ideas in social innovation, but perhaps we should also include those that know how to make sense and evaluate those ideas in our stable of talent and required skillsets for design teams.
Guiding Theories & Methods: Having good ideas is one thing, implementing them is another. But tying them both together is the role of theory and models. Theories are hypotheses about the way things happen based on evidence, experience, and imagination. Strategic designers and social innovators rarely refer to theory in their presentations or work. I have little doubt that there are some theories being used by these designers, but they are implicit, not explicit, thus remaining unevaluable and untestable or challenged by others. Some, like Frances Westley, have made theories guiding her work explicit, but this is a rarity. Social theory, behaviour change models and theories of discovery beyond just use of Rogers’ Diffusion of Innovation theory must be introduced to our work if we are to make better judgements about social innovation programs and assess their impact. Indeed, we need the kind of scholarship that applies theory and builds it as part of the culture of social innovation.
Problem scope and methodological challenges with it. Scoping social innovation is immensely wide and complicated task requiring methods and tools that go beyond simple regression models or observational techniques. Evaluators working social innovation require a high-level understanding of diverse methods and I would argue cannot be comfortable in only one tradition of methods unless they are part of a diverse team of evaluation professionals, something that is costly and resource intensive. Those working in social innovation need to live the very credo of constant innovation in methods, tools and mindsets if they are to be effective at managing the changing conditions in social innovation and strategic design. This is not a field for the methodologically disinterested.
Low attendance to rigor and documentation. When social innovators and strategic designers do assess impact, too often there is a low attention to methodological rigor. Ethnographies are presented with little attention to sampling and selection or data combination, statistics are used sparingly, and connections to theory or historical precedent are absent. Of course, there are exceptions, but this is hardly the rule. Building a culture of innovation within the field relies on the ability to take quality information from one context and apply it to another critically and if that information is absent, incomplete or of poor quality the possibility for effective communication between projects and settings diminishes.
Knowledge translation in social innovation. There are few fora to share what we know in the kind of depth that is necessary to advance deep understanding of social innovation, regularly. There are a lot of one-off events, but few regular conferences or societies where social innovation is discussed and shared systematically. Design conferences tend towards the ‘sage on the stage’ model that favours high profile speakers and agencies, while academic conferences favour research that is less applied or action-oriented. Couple that with the problem of client-consultant work that is common in social innovation areas and we get knowledge that is protected, privileged or often there is little incentive to add a KT component to the budget.
Poor cataloguing of research. To the last point, we have no formalized methods of determining the state-of-the-art in social innovation as research and practice is not catalogued. Groups like the Helsinki Design Lab and Social Innovation Generation with their vigorous attention to dissemination are the exception, not the rule. Complicating matters is the interdisciplinary nature of social innovation. Where does one search for social innovation knowledge? What are the keywords? Innovation is not a good one (too general), yet neither is the more specialized disciplinary terms like economics, psychology, geography, engineering, finance, enterprise, or health. Without a shared nomenclature and networks to develop such a project the knowledge that is made public is often left to the realm of unknown unknowns.
Moving forward, the challenge for social innovation is to find ways to make what it does more accessible to those beyond its current field of practice. Evaluation is one way to do this, but in pursuing such a course, the field needs to create space for evaluation to take place. Interestingly, FSG and the Center for Evaluation Innovation in the U.S. recently delivered a webinar on evaluating social innovation with the principle focus being on developmental evaluation, something I’ve written about at length.
Developmental evaluation is one approach, but as noted in the webinar : an organization needs to be a learning organization for this approach to work.
The question that I am left with is: is social innovation serious about social impact? If it is, how will it know it achieved it without evaluation?
It’s fair to imagine that one of the 2013 ‘words of the year‘ will be MOOC (which is not really a word, but an acronym that stands for Massive Open Online Course). It seems that everywhere you look in the higher education and professional development space we are seeing MOOC’s talked about and debated.
HBR editor Eric Hellwig, writing for the HBR blog, reported on a recent panel on MOOC’s held at the recent World Economic Forum in Davos with leaders like Bill Gates, Peter Thiel and Larry Summers. His report reflects the exuberance of the MOOC and the techno-deterministic spirit of much of the discourse on these tools:
The advent of massively open online classes (MOOCs) is the single most important technological development of the millennium so far. I say this for two main reasons. First, for the enormously transformative impact MOOCs can have on literally billions of people in the world. Second, for the equally disruptive effect MOOCs will inevitably have on the global education industry.
One of the panelists was Stanford professor Daphne Coller, the co-founder of Coursera, one of the largest MOOC providers offering more than 200 courses to millions of students worldwide. Coller has convinced top faculty at leading universities to provide high quality digital courses through Coursera for free and the result has surprised her.
We’re at 2.4 million students now. The biggest lesson I’ve learned on this is I underestimated the amount of impact this would have around the world. I really didn’t envision this scale and this impact this quickly.
Disrupting Education
Of these panelists, Peter Thiel may be the most controversial. He has spoken at length about the need to revamp education and sees technology and platforms like Facebook as a means to do it. (It’s worth noting that Theil was also an early investor in Facebook). He points to the multiple roles that education plays well beyond learning and suggests that when we go beyond that goal we start creating false economies of value within higher education:
You have to ask yourself, ‘What is the nature of education as a good?’ Ideally you want it to be learning. But it also functions as insurance. Parents will pay a lot of money for insurance against cracks in our society. Education as insurance has something to be said because it connects to the economy. You know computer science, you can get a job. But education also functions as a tournament. You do well if you go to a top school but for everyone else the diploma is a dunce hat in disguise. People need to understand what they’re trying to do? Is it insurance? A tournament? Learning?
Among Thiel’s biggest concerns is with the current educational system’s ability to support the kind of innovative thinking needed to make technological and scientific breakthroughs. So steadfast is he in the belief that some of the best minds are rotting in traditional classrooms that he founded the Thiel Fellowship, a scholarship fund to support promising young entrepreneurs in dropping out of school to pursue their ambitions of making social impact.
Thiel is disrupting education by taking learning away from the educational institutions charged with providing it. MOOC providers are seeking to develop a business model that puts them in the drivers seat of education and learning, drawing potential revenues away from traditional educational institutions. This will no doubt add to the pressures that universities and colleges are already facing as they rationalize ever more of what they do.
It’s been suggested that less than 10 per cent of those enrolled in a MOOC complete it. And of this 10 per cent, it isn’t clear what they learn, how well they learn it, and what kind of application (if any) that content is made to issues away from the course. Online courses with video tutorials, self-organized learning and largely uni-directional teaching bring together the best of former teaching methods like instructional TV, self-help, and classroom lectures.
There does not appear to be a difference in achievement between distance and traditional learners. Of the ten instructional features that were analyzed, only three had an impact on student achievement. These three features were type of interaction available during a broadcast, type of course, and type of remote site. There was an insufficient number of studies to ascertain whether or not the education level of the distance learners effected their achievement in the course (Machtmes & Asher, 2000).
While this review was done before widespread Internet use, the methods included reflected the same list above with one- or two-way audio and video. The studies were also done on programs that were designed for credit, not voluntary non-credit courses. Research on motivation will show that optional programs are far less likely to engender behavioural shifts than those that are mandated.
So who then is benefitting from MOOC’s? We don’t yet know, but it is likely those with time to attend to the content, high levels of intrinsic motivation (< PDF), the technological tools to succeed, and the environment that is ready to support integration of content into practice. That’s a tall order.
We are in the early days of MOOC’s and its too soon to tell how successful they will be. However, theoretically there is relatively little reason to expect that they will produce the kind of results worthy of hyperbole — at east not with those already accustomed to alternatives. To offer a MOOC from a world-class university to a learner somewhere in the world where education is but a distant dream achieves a great deal. But to transfer MOOC’s to replace more interactive and engaging methods — usually face-to-face — and expect great learning is a bit implausible.
Yet, with what we are offering now to students in the form of large classes, disconnected curricula, and didactic instruction MOOC’s offer an attractive option. What it loses is the experience of learning that is not packaged in a class. This means a change to campus life, the informal and serendipitous learning that comes from being in the same physical space interacting with each other, and may seriously limit the use of thinking and creative tools that design thinking and applied creativity demand. (for a detailed look at MOOC’s and the modern university check out Nathan Harden’s essay in the American Interest).
There is much ado about MOOC’s, but is this a Shakespearian tragedy in the making for learners?
Post-secondary and continuing education is continuing to be rationalized in ways that are transforming the very foundation of the enterprise. Funding is a major driver of change in this field: how much is available, when it flows, where it comes from, what is funded, and who gets the funding are questions on the minds of those running the academy.
At the centre of the focus of this funding issue is the job market. Training qualified professionals for the job market in various forms has been one of the roles a university has played for more than a century. Now that role has become central.
Let’s consider what that means and what it could do in shaping the various possible futures of the university. This second in a series looking at the post-secondary and continuing education focuses on the metrics of jobs.
“What are all these people going do?”
The employability of graduates is now the holy grail of education industry statistics. Earlier this year I was sitting on the stage at an academic convocation with a senior colleague staring out at a sea of soon-to-be-graduates when he leaned over and asked the question quoted above. Staring at a sea of masters and doctoral graduates numbered in the hundreds and knowing that this ceremony was held twice per year, the question stuck and remains without an answer.
Maybe there were enough jobs for that cohort, but this process gets repeated twice each year at universities around the world and each year that I’ve been a professor those numbers (of graduates) seem to go up. Some of our programs in the health sciences are admitting three times the number of students than they were just ten years ago. There is much demand for education (as judged by departmental applications), but are there jobs demanding this kind of education in its current form?
Yes, the Baby Boom is moving into an age of retirement and increasing needs for health services, but do we need to graduate 80+ Physical or Occupational Therapists to meet this need this year? Do we need a few dozen more epidemiologists or health promotion specialists to add to the pool? How about psychologists or social workers: how many of those do we need? The answer from my colleagues in these fields is: We don’t know.
Chasing the Wind
Jobs are a red herring. It’s one thing to have a job, but is it the job that you trained for? (And is having that job even a reasonable goal?) Being employed is not the same as building a career. What if you were trained perfectly for a job that no longer existed? Imagine a Blacksmith in the 20th century or a Bloodletter. These questions are not asked, nor is much asked about quality of education relative to the pressures of recruitment, cost-cutting and educational rationalization. Most of us don’t know what quality education is in real terms because we are measuring it (if we are measuring anything at all besides jobs) by standards set for the jobs of the past, not the future (or even the present?).
“Skate where the puck is going, not where it’s been.” – Wayne Gretzky
If education is rationalizing itself to focus more on jobs, then it also needs to get serious about clarifying what jobs mean, defining what ‘success’ looks like for a graduate, and whether those jobs are designed for where the proverbial puck is now or for where it is going.
Disruptive Learning / Disturbed Education
“The Only Thing That Is Constant Is Change -” ― Heraclitus
I’ve pointed out that learners have an uneasy relationship with learning principally because it means disrupting things. This is a topic I’ll be covering in greater depth in a future post, but if one considers how our social, economic, and environmental systems are changing it is not unreasonable to call this the age of disruption .
Change in complex systems is often logarithmic, not linear. It may be massively punctuated like a Lévy Flight or it could be closer to a random walk. In environments with a change coefficient that is large the level of attention must be more fine-grained than 5-year reviews. It requires developmental evaluation methods and learning organizations, not just conventional approaches to generating and assessing feedback. It requires mindful attention and contemplative inquiry to guide a regular reflective practice if one is to pay attention to the subtleties in change that could have enormous impact.
For example, if journalists and news media waited every five years to assess the state of their profession, they would have missed out on Twitter and come late to blogging, two of their (now) powerful sources of competition and tools of the trade. Some have waited, which is why they are no longer around. Metrics for journalism education today might consider the amount of exposure and proficiency in social media use, digital photography, use of handheld tools for communication, and real-time reporting skills. Metrics of the past might focus on newspapers and radio broadcasting. Which mindset, skillset and toolset would you rather be trained in today?
Questions for educators, learners (and evaluators):
Whether health sciences, journalism, human services or any field, what might some questions be that can help determine the role of job training in professional education? Here are five starters:
1. What is the state of your profession right now and are you training people for existing in this state? Are you preparing people for the next evolution?
2. Where is your field of practice going? What are the possible futures for your profession in the next 5, 10, and 20 years? Will it still exist? Are you a blacksmith looking for more horses in the automobile age or Steve Jobs waiting to attract people to a new graphical user interface?
3. Is your mindset, skillset or toolset in need of re-consideration? Does it still do the job you’ve hired it to do?
4. What do people need that your skills can help with? What unfilled needs and expectations are there in the world that your mindset, skillset and toolset could solve?
5. What would happen if your field of practice disappeared? How else could you apply what you know to making the contribution you wish to make and earn a living? What other skills, tools and ways of thinking would you need to adapt?
Design thinking can greatly help shape the way that one conceives of a problem, works through possible options, and develops prototypes to address the needs of the present and the future. Foresight methods help lay additional context for design and systems thinking by providing ways to anticipate possible futures for any given field. Lastly, knowing what the state of things are now and how they got to where they are now can help determine the path dependencies that education may have fallen into.
We can’t change what we don’t see and better foresight, hindsight and present sight is critical to better ensuring that education outcomes are not imagined, but based on something that can actually improve learning.
Social media is any networked information technology, tool or platform that derives its content and principal value from user engagement and permits those users to interact with that content. But last time I checked (in), the content stream being produced through my media stream was becoming a lot less social (Web 2.0) and more of a throwback to the media of old (Web 1.0); the implications could be considerable for those wishing to reach new audiences or create them in the first place.
The issue is not just one of control, but of a disrespect for the complexity and conversation that makes social media attractive to its users. In short: it’s about the social, not the media.
Social media, non social content
Scanning through my Facebook page its easy to see why their stock is dropping and will continue to do so. In their quest to justify their valuation, Facebook needs to find ways to make money from what people post and pictures of people’s kids, quips about daily hassles and joys, sharing cat videos, and posting check-ins at a local restaurant aren’t enough to justify a $100bn valuation. To do this, they need advertising dollars and deals with game makers and app developers to drive revenue up. Aside from the possibility of games, there is little social about advertising, no matter what kind of spin is offered.
Within a year my Facebook page has gone from a loose collection of social miscellany from friends and family to a steady stream of non-social junk with advertisements in the form of page updates, news stories that require me to accept an app that sends me more ads, and a litany of non-essential information.
The signal to noise ratio has officially flipped from more noise and less signal.
Bit by bit, Facebook is choking its users to death with ephemera and it would not surprise me if in two years we refer to it as we do MySpace today. YouTube is also running perilously close to offering too much media with not enough message as users increasingly have to sit through advertisements or click on banner ads before accessing content. News sites like the Globe and Mail will run a 30 second advertisement before allowing you to see a 20 second news clip, a 150% advertisement to content ratio on some stories.
I remember a few years ago when my email took the same turn. Now, probably 75 per cent of my received (non-spam!) email goes unread and is immediately deleted on sight. This isn’t necessarily spam, much of it is bacn, the kind of updates that I might have subscribed to voluntarily or I receive as part of a professional membership or affiliation. However, it’s severely disabled email’s potential and is now a ‘necessary evil’ instead of a useful tool I welcomed having in my toolkit.
Speaking to colleagues, it is not unreasonable to hear of people receiving messages in the hundreds each day and spending more than 3 hours per day just managing that content alone. How is this helping us communicate better? To learn?
This is one gigantic distraction and is not proving useful to improving our communications or helping us integrate the knowledge we receive and already have. Some claim that the era of big data will allow advertisers to target their ads with such exceptional focus and appropriateness that they will be serving us as much as we are needed to service them. I somehow doubt that.
When my social media stream is filled with promoted tweets, sponsored posts, ‘like’ requests on advertisements or updates from projects, I lose the social and just end up with media.
Social media is at its best when it is a conversation. Sometimes the conversation involves a lot of talking on one side, but there is a genuine back-and-forth, an unpredictability to it, and a non-linear dynamic that makes it interesting. Straight-to-viewer messages that offer no ways to engage except to watch, click off or ‘like’ don’t make for a conversation.
Imposing Structure and Losing Complexity
In trying to turn a setting where complexity, emergence and non-linearity come alive and work to create conversation, social media property managers are stifling the very thing that makes their tools and platforms so attractive. Creativity is born from serendipity and diverse connections. In imposing structures that remove or highly limit this potential for discovery by adding unnecessary noise, we are a risk of losing some of the best tools for idea testing, discussion, and knowledge translation we have ever known by reducing the opportunities for serendipity.
It is the commercial drive that contributed to bringing these tools in the first place, however that drive can lead to blindness creating an Internet ivory tower rather than a true marketplace of ideas as advocated in the Cluetrain Manifesto, which looked at how markets operate as innovation hubs by promoting conversations.
From markets to artists, the messages that are created by media are related to the media itself. Marshall McLuhan knew that and so did his peer, Edmund Snow Carpenter. Mathematician-artist a Youtube video maker vihart knows this too and spoke to Carpenter’s thesis in a terrific short video below.
In critiquing the push for standard ‘best practices’ in social media, vihart (and Carpenter, by posthumous extension) point to the ways in which the traditional media formats that advertisers desperately wish to use to contain your attention (and limit your feedback) is exactly the opposite of the new media.
Taken from the forward of Carpenter’s book, They Became What They Beheld, (and explicated beautifully by vihart) come some rules of communication commonly pursued by traditionalists and reasons why we shouldn’t pay attention. These rules as noted by Carpenter are:
1. Know your audience and address yourself directly to it
2. Know what you want to say and say it clearly and fully
3. Reach the maximum audience by using existing channels
Whatever sense this may have made in world of print, it makes no sense today. In fact, the reverse of each rule applies.
If you address yourself to an audience, you accept at the outset the basic premises that unite the audience. You put on the audience, repeating cliches familiar to it. But artists don’t address themselves to audiences; they create audiences. The artist talks to himself out lout. If what he has to say is significant, others hear & are affected.
The trouble with knowing what to say and saying it clearly and fully, is that clear speaking is generally obsolete thinking. Clear statement is like an art object: it is the afterlife of the process which called it into being. The process itself is the significant step and, especially at the beginning, is often incomplete and uncertain.
The problem with full statement is that it doesn’t involve: it leaves no room for participation; it’s address to consumer, not co-producer.
One is left watching this video with the question: what happens when social media has too much media, not enough message?
Metaphors and storytelling are ways to navigate through complex, inter-related ideas in a way that brings coherence and delight to them in narrative form. Stories are not just for children, but a serious tool for bringing complexity to life, making it accessible and usable to a world that can benefit from learning more about it.
Have you ever found yourself curled up in bed with a book that you can’t put down or found yourself up much later than you’d planned because of a TV program or movie you got caught up in? Ever have the same experience with a piece of academic writing? How about a technical report? I’ll bet the answer is yes to the former examples more than the latter (if there is a yes at all to the second two). Books — mostly, but not always, fiction books — magazine and newspaper, articles, poems and even blog posts thrive on a narrative that takes you a journey even if you don’t know the destination. That narrative, if its engaging, has consistency, a tone, a flow and a ‘texture’ that makes it enriching. It is perhaps the reason why so much scholarly writing is so dull: the texture is rather dry and lacks appeal.
Not all scientific articles require such appeal. Indeed, the standardized methods of reporting experiments can be very useful in interpreting results and deriving meaning from complicated interactions. Yet, this application of the standard model of writing from science to other areas is perhaps taking scholarly work to places it didn’t need to go. Or perhaps it is preventing us from going places we need to go.
In terms of complexity, one of those places it needs to go is into widespread discourse on public policy, health promotion, and social program planning. Storytelling and metaphors are one vehicle.
Making metaphors and embodied cognition
A recent Scientific American blog post by explored the role of metaphors in some depth, bringing attention to some of the early work of psycholinguist pioneers George Lakoff and Noam Chomsky in looking at the role of embodied cognition, a concept where a metaphor actually gets integrated into the body (literally or figuratively). In the column Samuel McNerny looks at the history of the idea and the use of metaphor, drawing on interviews, literature and recent research.
As Lakoff points out, metaphors are more than mere language and literary devices, they are conceptual in nature and represented physically in the brain. As a result, such metaphorical brain circuitry can affect behavior. For example, in a study done by Yale psychologist John Bargh, participants holding warm as opposed to cold cups of coffee were more likely to judge a confederate as trustworthy after only a brief interaction. Similarly, at the University of Toronto, “subjects were asked to remember a time when they were either socially accepted or socially snubbed. Those with warm memories of acceptance judged the room to be 5 degrees warmer on the average than those who remembered being coldly snubbed. Another effect of Affection Is Warmth.” This means that we both physically and literary “warm up” to people.
Metaphors like “warming up” are therefore representations of real phenomena that become figurative in certain scenarios. McNerny adds:
The last few years have seen many complementary studies, all of which are grounded in primary experiences:
• Thinking about the future caused participants to lean slightly forward whilethinking about the past caused participants to lean slightly backwards. Future is Ahead
• Squeezing a soft ball influenced subjects to perceive gender neutral faces as female while squeezing a hard ball influenced subjects to perceive gender neutral faces as male. Female is Soft
• Those who held heavier clipboards judged currencies to be more valuable and their opinions and leaders to be more important. Important is Heavy.
• Subjects asked to think about a moral transgression like adultery or cheating on a test were more likely to request an antiseptic cloth after the experiment than those who had thought about good deeds. Morality is Purity
The challenge for complexity in social life is coming up with the right metaphor and finding one that is embodied within the systems we seek to influence.
Telling systems stories
One of the best examples of the use of storytelling and metaphors to explain complexity comes from Dave Snowden of Cognitive Edge with his humourous, insightful look at order and the art of organizing a children’s party.
What Snowden does is anchor something new (complexity) in a familiar frame of reference (a children’s party). While this is not something that directly translates to how we operate social organizations such as “warming up” does to explain relations between people, it offers something close.
Anchoring the novel in the familiar. Childhood is the one universal we adults all share. Travel the globe and watch children interact and you’ll see patterns repeated everywhere. Emotion is another universal: joy, fear, anger, contentment, curiosity, and such are all platforms that can be used to create and share stories about our world. For those of us working in communities, we need to understand what universals exist in those realms. This means paying deep attention to the systems we are a part of.
In short: systems thinkers may need to be participant observers to the systems they wish to influence and learn about the big and small things that drive them.
As systems are large, complicated and complex, it is unreasonable and perhaps impossible to know everything necessary to successfully navigate through it and maneuver the leverage points necessary to create responsible, sustained systems change. To do so, we need to enlist others and that means getting complexity into the minds of many operating in the system and not just a few ‘systems thinkers’.
We need to get better at telling stories and marketing metaphors of meaning.
Learning storytelling from marketers
Marketing is largely about identity and stories about identity. Marketers want to influence what you do (choose, use, purchase, etc..) and how you experience what you do when you do it. To do this, they know the importance of design and the stories to accompany that design. Design, when done well, is partly about creating empathy with those who are to benefit from the products of design and the best products out there are ones that apply empathy and guide behaviour at the same time. Steve Jobs and his design team led by Jonathan Ive were (are) famous for doing this at Apple.
In an earlier post I mentioned the work of Rory Sutherland and his discussion of tobacco use as an illustration of the ways in which failing to empathize with a product user’s life can change the impact of policies and programs aimed to improve it. The case (made in the video below) is that there are some real, tangible benefits to smoking that get ignored when we aim to snuff it out (bad pun intended). For public health to enhance its effectiveness, we need to pay attention to these benefits and find ways for people to derive them in healthier contexts.
But listen to what Sutherland says not only here, but in another of his TED talks he points to ways in which small changes can have enormous consequences if done in a systems-forward manner (my term, not his).
What Sutherland does is not just provide good ideas, but tells good stories. Like Dave Snowden, he captures our interest and makes us want to think about concepts like behavioural economics and marketing just as Snowden inspires thinking about the differences between order and chaos.
Not all of us can be great storytellers or funnymen (and women), but we need to take this seriously if we wish to use complexity and systems thinking to advance change in our world purposefully, because massive change is happening whether we want it or not. The key is whether we will be telling stories in the future of how we helped shepherd change that helped us be more resilient and thrive or let these forces shape us in ways that caused unnecessary problems. It is, as Bruce Mau said, not about the world of design, but the design of the world.
The days of creating programs, products and services and setting them loose on the world are coming to a close posing challenges to the models we use for designing and evaluation. Adding the term ‘developmental’ to both of these concepts with an accompanying shift in mindset can provide options moving forward in these times of great complexity.
We’re at the tail end of a revolution in product and service design that has generated some remarkable benefits for society (and its share of problems), creating the very objects that often define our work (e.g., computers). However, we are in an age of interconnectedness and ever-expanding complexity. Our disciplinary structures are modifying themselves, “wicked problems” are less rare
Developmental Thinking
At the root of the problem is the concept of developmental thought. A critical mistake made in comparative analysis — whether through data or rhetoric — is one that mistakenly views static things to moving things through the same lens. Take for example a tree and a table. Both are made of wood (maybe the same type of wood), yet their developmental trajectories are enormously different.
Wood > Tree
Wood > Table
Tables are relatively static. They may get scratched, painted, re-finished, or modified slightly, but their inherent form, structure and content is likely to remain constant over time. The tree is also made of wood, but will grow larger, may lose branches and gain others; it will interact with the environment providing homes for animals, hiding spaces or swings for small children; bear fruit (or pollen); change leaves; grow around things, yet also maintain some structural integrity that would allow a person to come back after 10 years and recognize that the tree looks similar.
It changes and it interacts with its environment. If it is a banyan tree or an oak, this interaction might take place very slowly, however if it is bamboo that same interaction might take place over a shorter time frame.
If you were to take the antique table shown above, take its measurements and record its qualities and come back 20 years later, you will likely see an object that looks remarkably similar to the one you lefty. The time of initial observation was minimally relevant to the when the second observation was made. The manner by which the table was used will have some effect on these observations, but to a matter of degree the fundamental look and structure is likely to remain consistent.
However, if we were to do the same with the tree, things could look wildly different. If the tree was a sapling, coming back 20 years might find an object that is 2,3,4 times larger in size. If the tree was 120 years old, the differences might be minimal. It’s species, growing conditions and context matters a great deal.
Design for Development / Developmental Design
In social systems and particularly ones operating with great complexity, models of creating programs, policies and products that simply release into the world like a table are becoming anachronistic. Tables work for simple tasks and sometimes complicated ones, but not complex ones (at least, consistently). It is in those areas that we need to consider the tree as a more appropriate model. However, in human systems these “trees” are designed — we create the social world, the policies, the programs and the products, thus design thinking is relevant and appropriate for those seeking to influence our world.
Yet, we need to go even further. Designing tables means creating a product and setting it loose. Designing for trees means constantly adapting and changing along the way. It is what I call developmental design. Tim Brown, the CEO of IDEO and one of the leading proponents of design thinking, has started to consider the role of design and complexity as well. Writing in the current issue of Rotman Magazine, Brown argues that designers should consider adapting their practice towards complexity. He poses six challenges:
We should give up on the idea of designing objects and think instead about designing behaviours;
We need to think more about how information flows;
We must recognize that faster evolution is based on faster iteration;
We must embrace selective emergence;
We need to focus on fitness;
We must accept the fact that design is never done.
That last point is what I argue is the critical feature of developmental design. To draw on another analogy, it is about tending gardens rather than building tables.
Developmental Evaluation
Brown also mentions information flows and emergence. Complex adaptive systems are the way they are because of the diversity and interaction of information. They are dynamic and evolving and thrive on feedback. Feedback can be random or structured and it is the opportunity and challenge of evaluators to provide the means of collecting and organizing this feedback to channel it to support strategic learning about the benefits, challenges, and unexpected consequences of our designs. Developmental evaluation is a method by which we do this.
Developmental evaluators work with their program teams to advise, co-create, and sense-make around the data generated from program activities. Ideally, a developmental evaluator is engaged with program implementation teams throughout the process. This is a different form of evaluation that builds on Michael Quinn Patton’sUtilization Focused-Evaluation (PDF) methods and can incorporate much of the work of action research and participatory evaluation and research models as well depending on the circumstance.
Bringing Design and Evaluation Together
To design developmentally and with complexity in mind, we need feedback systems in place. This is where developmental design and evaluation come together. If you are working in social innovation, your attention to changing conditions, adaptation, building resilience and (most likely) the need to show impact is familiar to you. Developmental design + developmental evaluation, which I argue are two sides of the same coin, are ways to conceive of the creation, implementation, evaluation, adaptation and evolution of initiatives working in complex environments.
This is not without challenge. Designers are not trained much in evaluation. Few evaluators have experience in design. Both areas are familiarizing themselves with complexity, but the level and depth of the knowledge base is still shallow (but growing). Efforts like those put forth by Social Innovation Generation initiative and the Tamarack Institute for Community Engagement in Canada are good examples of places to start. Books like Getting to Maybe, M.Q. Patton’s Developmental Evaluation, and Tim Brown’s Change by Design are also primers for moving along.
However, these are start points and if we are serious about addressing the social, political, health and environmental challenges posed to us in this age of global complexity we need to launch from these start points into something more sophisticated that brings these areas further together. The cross training of designers and evaluators and innovators of all stripes is a next step. So, too, is building the scholarship and research base for this emergent field of inquiry and practice. Better theories, evidence and examples will make it easier for all of us to lift the many boats needed to traverse these seas.
It is my hope to contribute to some of that further movement and welcome your thoughts on ways to build developmental thinking in social innovation and social and health service work
There is a myth that we only use 10% of our brain, but we certainly don’t use the fullest array of creative means of communication at our disposal. What if designers, health promoters and those seeking to communicate better started considering a more sensory-forward way of sharing what they know to each other?
“Pheromones!”
“Pheromones?” I said.
“Yes. Think about how much we convey by pheromones?” my colleague said. “Imagine what we could explain if we knew what they told us?”
Indeed.
So started a conversation between three of us faculty at the annual Center for Contemplative Mind and Society annual faculty curriculum development program. The conversation was prompted by a performance by New York-based dancer and fellow contemplative Yin Mei the previous night that we found bereft of words to fully explain. The performance, and our conversation, The dance and movement performance blended film, sound, music, dance and kabuki-style masks in an interactive dance studio environment. If I wrote any more and I wouldn’t be doing the performance justice.
Here were three people who were literally involved in a performance virtually unable to share a common description of what they saw, even if it was the same thing. We three were stuck trying to come up with words to describe what we had experienced. Words, feelings, text all failed. And that is how we came up with our conversation.
Our discussion has inspired reflection on how much information we neglect and the types of information that we privilege when we design things and communicate what we know to the world around us.
Pheromones are a means of communication available to us to use. Yet, we don’t, nor have the knowledge of how to use them. We might develop an instantaneous connection with someone — even fall in love (or lust) — for reasons that make no rational sense to our brain, but it happens. We don’t have the sensory intelligence to make sense of the signals we receive, but we nonetheless transmit and receive a lot more than we are aware of.
When we seek to develop a design for something, good practice involves engaging a diversity of perspectives to generate ideas that create new knowledge, best suit the communication of those ideas, and develop those ideas into products, services and policies that best help people. However, our means of communicating these still remain with spoken and written words.
A touch can convey information that is immeasurable. A look, a feeling, a smell, a brush of a hand are all sensory means of conveying information and learning about our world. As we seek to tackle the kind of ineffable, yet persistent and pernicious problems that complexity introduces, new ways to express and share our understandings are necessary. There are simply times when words won’t or cannot do it.
The practical application of this sensory-based approach to design is not a simple venture. Western culture is not very kinesthetic making a lot of touch-based collaboration problematic. Add in the very real issues that those who’ve experience physical trauma or abuse, and such application of touch must be handled with care. But just as words can be weapons or means to joy, so too can touch if done with compassion, skill and sensitivity. Artful methods like dance, sculpture, or video could be means of communicating ideas that simple words cannot.
What if we could cultivate the means to be intimate with these methods in the service of better design and communication? What kind of design would that look like? Could we engage a much broader range of people into the discussion? Right now, we privilege those who can write and speak well, those who are forward (i.e., extroverted) and verbal, at the expense of those who might have as much to offer, but for whom writing, reading or oral communication might not be their strongest method of communication, yet that is all they are given.
We are more than our words and we can be more than what those words convey. It seems time to start taking this a little more seriously and seeing where it goes. Who knows? Maybe the best ideas are just a painting or dance away.
Yesterday I attended the Cure4Kids Global Health Summit at St. Jude Children’s Research Hospital in Memphis, Tennessee. The three day event (continuing for the next two days) aims to bring together researchers, practitioners, and clinicians working on issues of importance to child and youth health — including an emphasis on the role of engaging young people. Of the many presentations and conversations that were had on the first day of the event, the ones that struck me the most were on the potential of games and gaming to engage people and promote literacy.
Games are entered into voluntarily and allow for natural collaboration, creative exploration, and constant, developmental learning.
Developing serious games for health often requires artists, designers, users, engineers, social scientists, educators and health professionals working collaboratively so it provides a natural laboratory for design research and studies on participatory engagement on health issues.
But what excited me the most was seeing how games were being developed through games themselves. Small competitions, limited budgets and compressed timelines along with mentorship produced some amazing results (which will be discussed in a later post).
Watching it all, it opened my eyes to how gaming — the games and the process of creating the game itself – could offer so much to learning about innovation, discovery and collaboration.