Flipping the Flipped Classroom

Two of the hot topics in education in the last few years have been Massive Open Online Courses (MOOC’s) and the flipped classroom. I’ve been experimenting with both of them.

What I’ve learned (besides being able to use the word “pedagogy” in a sentence) is 1) assigning students lectures as homework doesn’t guarantee the students will watch them and 2) in a flipped classroom you can become hostage to the pedagogy.

Here’s the story of what we tried and what we learned.

MOOCs—Massive Open Online Courses

A MOOC is a complicated name for a simple idea—an online course accessible to everyone over the web. I created my MOOC by serendipity. Learning how to optimize it in my classes has been a more deliberate and iterative process.

When my Lean LaunchPad class was adopted by the National Science Foundation, we taught our original classes to scientists scattered across the U.S. We adopted WebEx, a web video conferencing tool, to hold our classes remotely. Just like my students at Stanford, these NSF teams got out of the building and spoke to 10-15 customers a week. Back in their weekly class, the scientists would present their results in front of their peers—in this case via Webex, as the teaching team gave them critiques and “guidance”. When their presentations were over, it was my turn. I lectured to these remote students about the next week’s objectives.

Is it Live or Is It a MOOC?

After the first NSF class held via videoconference, it dawned on me that since I wasn’t physically in front of the students, they wouldn’t know if my lecture was live or recorded.

Embracing the “too dumb to know it can’t be done,” I worked with a friend from Stanford, Sebastian Thrun and his startup Udacity, to put my Lean LaunchPad lectures online. Rather than just have me drone on as a talking head, I hired an animator to help make the lectures interesting, and the Udacity team had the insight to suggest I break up my lecture material into small, 2-4 minute segments that matched students’ attention spans.

Over a few months we developed the online lectures, then tried it as a stand-in for me on the NSF videoconferences, and found that because of the animations and graphics the students were more engaged than if I were teaching it in person. Ouch.

Now the NSF teams were learning from these online lectures instead of video conferenced lectures—but the online lectures were still being played during class time.

I wondered if we could be more efficient with our classroom time.

Flipping

Back at Stanford and Berkeley, I realized that I could use my newly created Lean LaunchPad MOOC and “flip” the classroom. It sounded easy, I had read the theory:

1) A flipped classroom moves lectures traditionally taught in class, and assigns them as homework. Therefore my students will all eagerly watch the videos and come to class ready to apply their knowledge.

2) This would eliminate the need for any lecture time in class. And as a wonderful consequence,

3) I could now admit more teams to the class because we’d now have more time for teams to present.

So much for theory. I was wrong on all three counts.

Theory Versus Practice

After each class, we’d survey the students and combine it with a detailed instructor post-mortem of lessons learned. (An example from our UCSF Lean LaunchPad for Life Sciences Class is here.)

Here’s what we found when we flipped the classroom:

  • More than half the students weren’t watching the lectures at home.
  • Without an automated tool to take an attendance, I had no idea who was or wasn’t watching.
  • Without lectures, my teaching team and I felt like observers. Although we were commenting and critiquing on students presentations, the flipped classroom meant we were no longer in the front of the room.
  • No lectures meant no flexibility to cover advanced topics or real time ideas past the MOOC lecture material.

We decided we needed to fix these issues, one at a time.

  • In subsequent classes we reduced class size from 10 teams to eight. This freed up time to get lecture and teaching time back in the classroom.
  • We manually took attendance of who watched our MOOC (later this year this will be an automated part of the LaunchPad Central software we use to manage the classes).
  • To get the teaching team front and center, I required students to submit questions about material covered in the MOOC lecture they watched the previous evening. I selected the best questions and used them to open the class with a discussion. I cold-called on students to ensure they all had understood the material.
  • We developed advanced lectures which combined a summary of the MOOC material with new material such as lectures focused on domain specific perspectives. For example, in our UCSF Life Sciences class the four VCs who taught the class with me developed advanced business model lectures for therapeutics, diagnostics, medical devices and digital health. (These advanced lectures are now on-line and available to everyone who teaches the class.)

The class, now taught as hybrid flipped classroom, looks like this: Lean LaunchPad Class Organization

There’s still more to do.

  • While we use LaunchPad Central to have the teams provide feedback to each other, knowledge sharing across the teams still needs to be deeper and more robust.
  • While we try to give students tutorials for how to do Customer Discovery we need a better way to integrate these into the short time in quarter/semester.
  • While we insist that an MVP is part of the class, we need a more rigorous process for building the MVP in parallel with Customer Discovery

Outcomes

Besides finding the right balance in a flipped classroom, a few other good things have come from these experiments. The Udacity lectures now have over 250,000 students. They are not only used in my classes but are also part of other educators’ classes, as well as being viewed by aspiring entrepreneurs as stand-alone tutorials.

My experiments in how to teach the Lean LaunchPad class have led to a 2 ½ day class for 75 educators per quarter (information here.) And we’ve found a pretty remarkable way to use the Lean LaunchPad to organize corporate innovation/incubator groups. (We opened source our teaching guide we use in the classes here.)

Lessons Learned

  • Creating engaging MOOCs is hard
  • Confirming that students watched the MOOCs is even harder
  • The flipped classroom needs to be balanced with:
    • Student accountability
    • Instructor time in front of the class
    • Advanced lectures

Author: Steve Blank

A prolific educator, thought leader and writer on Customer Development for Startups, Steve Blank is a retired serial entrepreneur who teaches, refines, writes and blogs on “Customer Development,” a rigorous methodology he developed to bring the “scientific method” to the typically chaotic, seemingly disorganized startup process. Now teaching entrepreneurship at three major universities, Blank co-founded his first of eight startups after several years repairing fighter plane electronics in Thailand during the Vietnam War, followed by several years of defense electronics work for U.S. intelligence agencies in “undisclosed locations.” Four Steps to the Epiphany, Blank’s fast-selling book, details the Customer Development process and is increasingly a “must read” among entrepreneurs, investors, and established companies alike, when the focus is optimizing a startup’s chances for scalability and success. After 21 years driving 8 high technology startups, today Steve teaches entrepreneurship to both undergraduate and graduate students at U.C. Berkeley’s Haas School of Business, Stanford University’s School of Engineering and the Columbia/Berkeley Joint Executive MBA program. His “Customer Development” teaching and writing coalesce and codify his experiences and observations of entrepreneurs in action, including his own and those he advises. “Once removed from the day-to-day intensity of founding a startup, I was able to observe a pattern that distinguishes successful startups from failures,” Blank says. In 2009, he earned the Stanford University Undergraduate Teaching Award in Management Science and Engineering. The San Jose Mercury News listed him as one of the 10 Influencers in Silicon Valley. In 2010, he was earned the Earl F. Cheit Outstanding Teaching Award at U.C. Berkeley Haas School of Business. Despite these accolades, Steve says he might well have been voted “least likely to succeed” in his New York City high school class. Steve Blank arrived in Silicon Valley in 1978, as boom times began. His early startups include two semiconductor companies, Zilog and MIPS Computers; Convergent Technologies; a consulting stint for Pixar; a supercomputer firm, Ardent; peripheral supplier, SuperMac; a military intelligence systems supplier, ESL; Rocket Science Games. Steve co-founded startup number eight, E.piphany, in his living room in 1996. In sum: two significant implosions, one massive “dot-com bubble” home run, several “base hits,” and immense learning leading to The Four Steps. An avid reader in history, technology, and entrepreneurship who seldom cracks a novel, Steve has followed his curiosity about why entrepreneurship blossomed in Silicon Valley while stillborn elsewhere. It has made him an unofficial expert and frequent speaker on “The Secret History of Silicon Valley.” Steve’s interest in combining conservation with best business practices had Governor Arnold Schwarzenegger appoint him a Commissioner of the California Coastal Commission, the public body which regulates land use and public access on the California coast. He also serves on the Expert Advisory Panel for the California Ocean Protection Council. Steve serves on the board of Audubon California, was its past chair, and spent several years on the Audubon National Board. A board member of Peninsula Open Space Land Trust (POST), Blank recently became a trustee of U.C. Santa Cruz and a Director of the California League of Conservation Voters (CLCV). Steve’s proudest startups are daughters Katie and Sara, co-developed with wife Alison Elliott. The Blanks live in Silicon Valley.