The Complex Universe of Alternative Postsecondary Credentials and Pathways

The Current Landscape of Alternatives

Back to table of contents
Authors
Jessie Brown and Martin Kurzweil
Project
Commission on the Future of Undergraduate Education

In this section, we provide more detail and examples for five categories of alternative providers. The first three providers—certificate programs, work-based training programs, and skills-based short courses—fall into the broader category of labor market training and credentialing but are distinct enough for separate discussions. The final two are MOOC providers and competency-based degree programs. For each category, we describe the common features and major variations of credentials and training, provide a brief historical background, offer illustrative examples, and analyze available data on enrollments, cost, and outcomes. We then discuss ways in which alternative providers have challenged or exerted pressure on traditional funding and accreditation requirements and other ways in which they intersect with traditional academic degrees and degree programs.


Labor Market Training and Credentialing

The first three programs we review—certificate programs, work-based training, and coding bootcamps—can all be categorized as labor market training and credentialing. What brings these programs together is a common end: a credential certifying that the completer possesses basic skills to enter an occupation. While these credentials can take the form of associate’s and bachelor’s degrees, we focus on nondegree credentials, including certificates, industry-recognized certifications, and licenses, and the pathways to achieving them.

Certificates, a growing category of labor market credential, are provided by public, private, and for-profit institutions that also award degrees, as well as by nondegree-granting institutions. They require classroom time, in-person or online, at an educational institution, and often cover both technical and academic content. Such programs also typically require on-the-job training or fieldwork in the form of apprenticeships or internships. Nearly 967,000 certificates were awarded at Title IV institutions alone in 2013—a steep increase from approximately 558,000 in 2000 (see Figure 2).23

Industry-recognized certifications differ from certificates in that they are validated by a corporation or industry organization rather than a postsecondary institution. Though requirements vary by industry and state, programs leading to industry credentials almost always include a written, oral, or performance-based assessment of industry-defined competencies. Some also require that individuals earn an academic degree before certification.

Certificates and industry-recognized credentials tend to be optional, unlike licenses, which are necessary to practice in some industries. Licenses are awarded by licensing agencies, which are often public entities. Criteria for licensure vary by industry but usually include a mix of education, work experience, the attainment of other credentials, and an assessment.

A 2012 analysis estimated that 19.3 percent of adults who reported that they had attended some college held a professional certification or license, and 13.9 percent of adults with only a high school diploma held such a credential.24 The ARMY COOL database lists 1,566 types of certification. These certifications are awarded by industry associations, but only 443 are validated by a third-party accrediting body. The largest independent validators of industry-recognized certifications are the International Certification Accreditation Council, the American National Standards Institute, and the Institute for Credentialing Excellence.25

Because of the varied and usually multiple criteria for attaining labor market credentials, pathways to earning them are diverse and can include academic programs (including certificate programs), workforce development programs, corporate training programs, or self-study (or a combination of these). Certificate programs and corporate training often incorporate curriculum to prepare students for industry certification and licensure assessments. In turn, industry organizations provide resources or engage in partnerships with certificate programs to create pathways to professional certification. In recent years, federal legislation and funding have incentivized such partnerships. For example, the U.S. Department of Labor’s Trade Adjustment Assistance Community College and Career Training Grant Program includes requirements that recipients incorporate industry-based credentials into their programs. Similarly, the Carl D. Perkins Career and Technical Education Act of 2006 and Workforce Innovation and Opportunity Act of 2014 incentivized the creation of pathways in secondary and postsecondary programs that are aligned with industry standards.26

To account for the overlapping nature of these credentials, we organize our discussion of them around pathways and providers: institutional providers of certificate programs, which can lead to industry certification; entry-level corporate training and workforce development programs, which usually lead to industry certification (or even licensure); and coding bootcamps, which borrow elements from both of these pathways to provide labor market training and credentialing for the technology industry.


Certificate Programs

Certificate programs are offered mainly by community colleges and for-profit schools, although some four-year public and private not-for-profit institutions offer them as well. These programs emphasize skills-based and demand-driven training in fields such as health care (the most popular option), business, information technology, manufacturing, agriculture, and consumer services.27 Most schools offer programs of varying lengths, including short-term certificate programs that last for less than a year, medium-term certificate programs that last from one to two years, and longer-term programs that take from two to four years to complete. Certificate programs enroll larger shares of women, African Americans, and students from families with lower incomes and less educational attainment than academic associate’s or bachelor’s degree programs. A little more than half of completers in these programs are between the ages of 18 and 29.28


History

The development of certificate programs is part of the larger history of industrialization and vocational education in America. Trade schools and mechanics institutes first emerged outside the existing college and university system in the mid-nineteenth century. Around the turn of the century, Congress passed several pieces of legislation that expanded funding for vocational training at public secondary and postsecondary schools.29

World War II and its aftermath were turning points in the growth of the higher education sector, both academic and vocational. The influx of returning veterans with funding from the G.I. Bill put pressure on existing colleges to expand their capacity and prompted the creation of hundreds of new institutions that focused specifically on preparing adult learners for employment.30 The number of for-profit schools, which had existed in some form since the colonial era, tripled in the five years following passage of the G.I. Bill. Community colleges grew from 238 colleges in 1941 to 330 in 1950, with a newly defined focus on terminal vocational degrees and serving the employment and educational needs of their communities.31 The Higher Education Act of 1965, which established Title IV eligibility, also increased access and diversity in the sector, and a crucial amendment in the 1972 authorization extended aid to “proprietary colleges.”32 Since the 1980s, both the number of students who seek out and attain certificates and the number of institutions that award them have increased dramatically, especially in the for-profit sector.33


Overview of Current Providers

Estimating the number and characteristics of certificate programs and students is challenging, especially for the approximately 3,000 for-profit institutions that are not eligible to receive financial aid under Title IV.34 Even certificate program data that Title IV–eligible institutions provide to the National Center for Education Statistics (NCES) is suspect: some institutions report only on their Title IV–eligible certificate programs, while others report on all of their certificate programs, even those that are not Title IV–eligible.

Despite these limitations, available data on Title IV institutions provide a sense of the scale and distribution of these programs. In 2013, 4,845 Title IV institutions offered certificate programs. Less-than-two-year for-profit schools, commonly known as trade schools, make up the largest share of Title IV institutions that offer certificate programs (see Figure 2). The average enrollment in a trade school is fewer than 100 students, and most programs these institutions offer are in consumer services and cosmetology. Most degree-granting two-year and four-year for-profit schools also offer certificate programs, focused heavily on consumer services and health services.35

Both trade schools and degree-granting for-profits have come under increased scrutiny in the past decade. In 2014, the Department of Education promulgated the so-called gainful employment rule, which conditions Title IV eligibility on the ratio of the average graduate’s loan payment to his or her total earnings.36 Several for-profit colleges have also been targeted for enforcement actions by the Department of Education. In August 2016, ITT Tech, a national technical institute with more than 100 campuses across the country, was disqualified from financial aid and barred from enrolling new students because of multiple investigations into its management of federal aid.37 In September 2016, ITT announced that it would close its doors.38

While fewer public two-year colleges than for-profit schools offer certificate programs, community college programs tend to be larger and therefore award the plurality of certificates.39 Average net cost for these programs is often significantly lower than that of for-profit institutions, and public two-year schools tend to have more diverse offerings than for-profit schools (and especially trade schools).40 As with two-year and four-year for-profit schools, the most commonly awarded certificates at these institutions are in the health sciences. However, community colleges also offer programs and award many certificates in business management; consumer services; engineering, architecture, and science technologies; manufacturing; and protective services.41

Figure 3 shows the change over time in certificates awarded by trade schools, for-profit two- and four-year institutions, and community colleges. While all three institutional types have awarded more certificates over time, for-profit colleges have increased the number of certificates that they award most dramatically, from 76,220 in 2000 to 190,466 in 2013, with a particularly sharp increase in the first years of the Great Recession. However, for-profits awarded fewer total credentials in 2013 than in 2012, and growth at community colleges slowed. These results likely reflect increased regulation of the for-profit sector, as well as a countercyclical decrease in enrollment due to an improving economy.42


Figure 3: Certificates Awarded by Institutional Type, 2000–2013

Figure 3: Certificates Awarded by Institutional Type, 2000–2013

Source: U.S. Department of Education, National Center for Education Statistics, Integrated Postsecondary Education Data System (IPEDS) Institutional Characteristics (IC) and Completions Components, “Table P160. Number of undergraduate credentials awarded by Title IV postsecondary institutions, by control and level of institution and credential level: United States, selected years 2000–2012, https://nces.ed.gov/surveys/ctes/tables/P160.asp; “Table P152. Total number of credentials awarded by Title IV postsecondary institutions, overall and in occupational education, by control and level of institution and detailed field of study, United States, 2013,” https://nces.ed.gov/surveys/ctes/tables/P152.asp.

More than half of certificates earned at all institutions are short-term certificates, though labor market returns are greater for longer programs.43 Labor market returns also vary by field, which tends to be correlated with provider type: individuals who hold certificates in computer and information services, electronics, and business and office management (usually from community colleges) and who work in those fields make more than at least half of associate’s and bachelor’s degree holders; they also have at least a 50 percent earnings premium over those with only a high school diploma (who earn, on average, about $30,000 per year). Certificate holders in the health sciences and cosmetology (fields in which a large majority of employees are women, and most certificates awarded are short-term certificates from for-profit schools) make, on average, between $20,000 and $25,000 per year (see Figure 4).


Figure 4: Average Annual In-Field Earnings for Certificate Holders by Field

Figure 4: Average Annual In-Field Earnings for Certificate Holders by Field

Source: Anthony Carnevale, Stephen J. Rose, and Andrew R. Hanson, “Certificates: Gateway to Gainful Employment and College Degrees,” Georgetown University Center on Education and the Workforce (June 2012), https://cew.georgetown.edu/wp-content/uploads/2014/11/Certificates.FullReport.061812.pdf. Certificates in cosmetology, health care, and auto mechanics tend to be short-term certificates; health care, business management, and cosmetology are majority-women fields.


Intersections and Future Directions

Policy-makers, researchers, and advocacy groups have promoted certificate programs as promising pathways to degrees and employment, especially for typically disadvantaged groups.44 Proponents view the responsiveness of the programs to economic conditions as a strength and have promoted partnerships among employers, educational institutions, and other nonprofits to create short-term certificate programs in high-demand fields.45 In 2011, a Department of Education experimental sites initiative allowed students in 46 short-term vocational programs that exceeded 150 clock hours and met local workforce needs to use Pell Grants toward those programs.46

States and institutions are also involved in efforts to incorporate shorter-term certificates into stackable or latticed credentials, so that curricula across certificate and degree programs are clearly aligned and students can transfer credits easily.47 Oregon’s community college system and Wisconsin’s technical college system have created modularized, credit-bearing, specialized credentials that can be combined for the receipt of a more general degree in the field. For example, a student could obtain an accounting clerk certificate, a payroll clerk certificate, and a business assistant certificate to earn an associate’s degree in accounting.48 Additionally, Lumina Foundation is coordinating a Connecting Credentials initiative that uses competencies as a framework for stacking credentials, including certificates, from a diverse set of providers.49

While many policy-makers and institutions have recognized the potential of short-term certificate programs, the potential for fraud or abuse in the sector has also been widely acknowledged, and the evidence base for the public and private returns from certificate programs is thin. To address these concerns, groups like the Certification Data Exchange Project and the Workforce Credentials Coalition are working to improve data collection and exchange on certificates and other workforce credentials.50


Work-Based Training

Employers have a long tradition of providing training for their employees to prepare for and advance in their careers, often at no or little direct cost to the employee. Entry-level corporate training and workforce development programs usually lead to an industry-recognized certification, either associated with a specific employer (such as a Cisco certification) or awarded by an industry association. Like certificate programs, these programs lead to careers in trades and usually cater to lower-income adults who do not have access to or preparation for traditional degree programs. Programs reviewed here are structured as apprenticeships and other forms of on-the-job training. Participants are usually connected with these opportunities as employees at companies, through local community development initiatives, or through academic programs.


History

On-the-job training has its roots in the preindustrial apprenticeship system, a practice that persists, in a modern form, to this day. Industrialization introduced new forms of work-based training in the late nineteenth century: with accelerated demand for workers skilled at operating new machinery, companies began creating their own factory schools to train their workers and started to experiment with “hybrid” and simulated training as well. Around the turn of the twentieth century, companies also began to understand the importance of corporate training as a tool to build a unified organizational culture and approach, and began to create materials, sites, and proprietary techniques for training.51

Throughout the twentieth century, developments in on-the-job training have often been at the vanguard of more-general advancements in instructional delivery: in the 1950s, companies began to experiment with individualized and modularized instruction; and in the 1950s and 1960s, companies began to utilize instructional design and computer-assisted pedagogy. These efforts were bolstered by the emergence of networked technology in the 1980s and 1990s, and corporate training programs were some of the first educational programs to rely heavily on computer-based training and blended-learning approaches to supplement on-the-job skill development. In 2015, companies delivered, on average, 53.8 hours of training per learner, marking a slight increase from previous years in the use of technological tools and techniques such as blended instruction, online instruction, and learning management systems.52 While current sources of data are limited, several studies from the 1990s indicate that employer-provided training is more likely to target employees with higher levels of formal education than entry-level or less-educated employees.53


Overview of Current Providers

For many employees, employer-provided, on-the-job training offers an alternative pathway to a degree. For example, Jiffy Lube University combines competency-based computer-mediated instruction with hands-on training and proficiency assessments for its new auto technicians, who tend to be between the ages of 18 and 25, in their first job, and do not possess a bachelor’s degree. Participants receive Jiffy Lube auto technician certificates upon completing the program and can also receive college credit through the American Council on Education (ACE) and the American Society for Training and Development.54 Onshore Outsourcing, a Missouri-based company that is committed to keeping IT jobs domestic, has a rigorous, bootcamp-style training program for developing IT professionals. Eighty percent of the company’s 150 employees did not attend college, and the organization specifically targets underemployed individuals in rural areas to help them develop their skills and obtain jobs.55

In addition to employer-provided and employer-sponsored training, entry-level employees access training through workforce development partnerships among employers, educational institutions, nonprofit organizations, industry groups, and federal programs. For example, subsidized on-the-job training programs have been sustained by federal workforce development legislation for more than 40 years. In these programs, workforce development agencies or other organizations provide firms with subsidies that cover 50 to 60 percent of trainees’ wages, thus offsetting the firms’ training costs. The subsidized firms provide training to employees in programs that usually last three to nine months, and in most cases trainees are expected to continue as full-time employees after the training period.56 Individuals served by these programs are usually underemployed, lack postsecondary education, or face other disadvantages in securing employment (such as single mothers or individuals with criminal records).57

Apprenticeships are another form of work-based learning and can either be provided by a single employer or be part of a larger training program coordinated by multiple entities, usually in a single geographic region. In some industries, individuals must complete some school-based training before beginning an apprenticeship and, in many cases, apprenticeships can count toward college credit. Apprenticeships are particularly popular in the electrical, construction, and manufacturing industries and, according to the Department of Labor, nearly 500,000 individuals participated in apprenticeships in 2015.58 Programs typically last one to three years, and participants usually receive industry-specified instruction and wages throughout their training.59 One innovative recent example is a regionally based apprenticeship program for welders and machine operators in Ohio that brings together several small and medium-size manufacturers to coordinate training standards, wages, and curricula. The program allows participants to receive college credit and credentials from the National Career Readiness Center and from industry-specific organizations. Unions also provide registered apprenticeships and other training options for entry-level employees to gain career skills and earn industry-recognized certifications.60


Intersections and Future Directions

Work-based training often draws on resources from certificate or academic programs from higher education institutions and may help an employee progress toward a certificate, an industry-recognized certification, a license, or a degree. Certificate programs often prepare students directly for industry-recognized certification assessments, and corporations frequently partner with educational institutions so that students earn an employer-recognized certification and job-relevant training as they earn a certificate or degree. For example, in Ford’s Technical Career Entry Program, students alternate between classroom time and Ford internships while earning an associate’s degree from a partner college, as well as Ford Service Technician Specialty Training credentials.61 The Cisco Networking Academy, which provides self-study materials for Cisco certifications, also partners with secondary and postsecondary institutions to train students for certification.62

Partnerships often cohere around regional, sector-based needs and are driven by local employers and educational institutions.63 For example, in and around Charlotte, North Carolina, several manufacturing companies and Central Piedmont Community College participate in the Apprentice 2000 program, which provides participants with 8,000 hours of apprenticeship training and academic study and leads to an associate’s degree from Central Piedmont Community College, a Journeyman’s Card, and certificates from the state of North Carolina and the U.S. Department of Labor.64 Des Moines Area Community College’s Accumold and Vermeer Scholars programs have partnered with local manufacturers so that students earn degrees or certificates while receiving job training at a local company. Business partners are able to take an active role in shaping their future workforce by participating in the recruitment and screening of program participants.

Finally, employers have a long tradition of helping students earn degrees from traditional institutions. For example, courses taken through corporate training programs at Jiffy Lube, Starbucks, and McDonald’s are all validated by ACE so that students can transfer the credit they earn to select degree programs. Corporations commonly assist employees pursuing a degree, and several targeted partnerships have recently emerged between companies and universities. These programs offer enrollees more wrap-around support, advisement, and resources than typical tuition reimbursement programs. For example, in 2015, Starbucks and Arizona State University launched a partnership through which employees could pursue four-year, online degrees tuition-free. Similarly, JetBlue covers most of the cost for employees pursuing a degree at Thomas Edison University.65


Skills-Based Short Courses

With the emergence and popularity of coding bootcamps, skills-based short courses, which have existed in some form for centuries, have gained renewed attention. These courses, which can stand on their own or be incorporated into other credentialing programs (such as certificate programs), are usually intensive courses that last for less than one year and focus solely on preparing students for jobs in specific fields. At the end of these courses, students may earn a credential (such as a short-term certificate) or compile a portfolio, and some, including coding bootcamps, offer job placement programs or job placement guarantees. This section gives a brief history and overview of offerings in this category (which overlaps with our other labor market and credentialing categories), but focuses on coding bootcamps because of their recent and rapid growth and relevance to changing employer needs.


History

Though this section focuses primarily on coding bootcamps, these offerings are part of a larger category of short, skills-based offerings that include short-term certificate programs and intensive short courses offered through schools of continuing education or professional schools. Continuing education for career advancement has its roots in nineteenth-century mechanics institutes and the lyceum movement, and universities began offering extension programs and short courses for in-demand fields in the final decades of the nineteenth century. For example, the University of Wisconsin-Madison began offering intensive 12-week short courses in farming education in 1886 (agriculture was a particular focus of early extension programs), and continues to offer short courses scheduled around the farming season.66 As the meatpacking industry grew in Chicago in the early twentieth century, the University of Chicago’s Meatpacking Institute began offering evening, correspondence, and full-time classes for men looking to enter or advance in the industry.67

Short-term certificate programs are also part of a longer history of vocational education at trade schools and community colleges. The number of institutions that offer these programs and the number of students who complete them have grown significantly over the past three decades. Trade schools that offer short-term certificates have emerged and evolved with their industries to meet the demand for employees or new schools. For example, for-profit career colleges emerged in the mid-nineteenth century to meet the growing need for workers with skills in fields like bookkeeping, stenography, typing, and electrical trades. The first beauty schools opened in the 1920s and 1930s in response to changing women’s styles that required the use of new tools and technical skills.68

Much like career colleges and other trade schools, coding bootcamps, which emerged in 2012, have developed in response to a growing and urgent need for employees with skills in high-demand fields. These programs, which prepare students for entry-level positions in programming, data science, and related technical fields, have expanded rapidly over the past several years, from 2 in January 2012 with 49 enrolled students, to 34 in January 2014 with 2,550 students, to 91 full-time programs in 2016 (other estimates put the total number of providers closer to 200).69


Overview of Providers

Short-term certificate programs and skills-based short courses continue to be popular pathways for adult learners to build career-specific skills and earn credentials. Both are typically offered through Title IV for-profit and nonprofit institutions, extension programs at four-year schools, and unaccredited trade schools. While short-term certificate programs typically focus on vocational fields and are available to students without a previous postsecondary degree, bachelor’s degree holders are increasingly earning certificates to augment their skill sets and advance in their careers. Short courses can be part of certificate programs or can be offered on their own through professional schools or schools of continuing education, in which case they typically cater to adults who have already earned secondary degrees. In the former category, the University of Wisconsin-Madison’s College of Agricultural and Life Sciences offers six-week, intensive short courses for students looking to advance their skill set in the agricultural sciences. Students can stack short courses to earn one of six one-year or two-year certificates, and courses are advertised as alternatives to a four-year degree. Catering to a different demographic, New York University’s Stern School of Business offers three- to five-day short courses in leadership and strategy, finance and risk management, and business analytics and marketing. These courses are targeted toward executives, and participants can earn professional credit for completion.70

Coding bootcamps, which also focus on intensive skill development, are the most recent additions to the category of short, skills-based courses. These programs usually last around 12 weeks, are full-time, and equip students with the skills needed for high-demand jobs as developers, designers, or data scientists in the technology industry. Bootcamps often partner with specific employers, have robust job placement programs, and focus on helping students build a portfolio of work to take with them out on the job market. Providers claim to boost graduate income by as much as 40 percent by equipping graduates with skills that are in high demand.71 Bootcamps are mostly located in large, urban centers such as San Francisco, New York, and Seattle, cost $11,000 on average, and were projected to earn $200 million in revenue in 2016. Popular providers include General Assembly, Hack Reactor, and DevBootcamp.72

In 2016, Course Report, a directory and review site for coding bootcamps, reported that nearly 18,000 participants would complete coding bootcamps in that year. However, despite their rapid growth and media attention, coding bootcamps are not yet an alternative to undergraduate education. A 2015 survey of coding bootcamp completers found that 79 percent already had at least a bachelor’s degree, and the average age of a participant was 31. Only 17 percent of completers had less than an associate’s degree, and the majority of this group had completed some college (see Figure 5). On average, graduates had 7.6 years of work experience before enrolling in a bootcamp.73


Figure 5: Coding Bootcamp Completers by Previous Education Level, 2015

Figure 5: Coding Bootcamp Completers by Previous Education Level, 2015

Source: Liz Eggleston, “2015 Coding Bootcamp Alumni & Demographics Study,” Course Report (October 25, 2015), https://www.coursereport.com/reports/2015-coding-bootcamp-job-placement-demographics-report#Table1.

Nevertheless, some indicators suggest these programs may emerge as undergraduate alternatives. First, because most coding bootcamp completers have little educational or professional experience with coding before enrolling, it would be inaccurate to equate completion of a coding bootcamp with the completion of an advanced degree, which usually builds upon a bachelor’s degree or work experience in a similar subject. For example, in 2015, 45 percent of coding bootcamp graduates reported they coded “some in their free time,” and 33 percent said they had no experience.74

Furthermore, coding bootcamps, more so than traditional programs, have leveraged scholarships and specialized programs to attract and support students from demographic groups not often found in computer science departments. In 2014, only 14.7 percent of those who received bachelor’s degrees in computer science or computer engineering were women.75 By contrast, 36 percent of 2015 coding bootcamp completers were female.76 Additionally, a little more than 20 percent of coding bootcamp completers were of Hispanic origin, compared with 7.7 percent of those with bachelor’s degrees in computer science and computer engineering.77 Part of the reason for this is cost. While the unavailability of federal financial aid means that most participants pay for coding bootcamps out of pocket, the opportunity costs associated with coding bootcamps are significantly lower than those associated with a degree program. Yet starting salaries for coding bootcamp graduates and bachelor’s degree holders are similar.78


Intersections and Future Directions

The financial aid status quo for bootcamps may be changing. Four of the eight partnerships selected for EQUIP were between traditional institutions and coding bootcamps: SUNY Empire State College and the Flatiron School; the University of Texas, Austin, and MakerSquare; Wilmington University and Zip Code Wilmington; and Marylhurst University and Epicodus. These programs enroll undergraduate students who are already enrolled at the partner institutions.79 Except for the Wilmington partnership, each offers students a certificate of completion.

Other partnerships between universities and coding bootcamps have emerged outside of the EQUIP program. These include a partnership between coding bootcamp Galvanize and the University of New Haven to offer students an accelerated data science master’s degree, and a partnership between Lynn University and General Assembly to offer a semester-long technology design bootcamp to undergraduates. At least one institution—Northeastern University—has opened its own analytics bootcamp, called Level.80 Tuition for these programs is at least as high as degree program tuition (Lynn University’s bootcamp is $16,000 for 16 weeks), and most are not eligible to receive federal financial aid. In addition, while some are open to undergraduates, most, like other coding bootcamps, target working professionals.81


MOOCs and Online Micro-Credentials

Massive Open Online Courses (MOOCs) are online courses that accommodate high or unlimited enrollment. The core component of MOOC content is usually the video lecture with supplementary problem sets, readings, assessments, and user forums or other collaborative features. Students can audit self-paced courses for free or pay a variable price (usually under $100) to earn a verified badge or certificate for completing a scheduled course or series of courses.82 MOOCs, in general, are broadly distributed across subjects and disciplines. Some providers specialize in certain types of content, and the percentage of computer science, programming, and business courses has grown disproportionately in recent years.83


History

MOOCs have their roots in correspondence courses and distance education, and draw on a long history of in-person and distance lifelong learning options. The emergence of multimedia technology, such as radio, television, and the video cassette, enabled providers of distance learning to extend their reach dramatically in the second half of the twentieth century, enabling remote, media-based correspondence courses for credit and enrichment. The expansion of the Internet in the late 1990s and 2000s dramatically reduced the marginal cost of enrollment and essentially eliminated geographic boundaries to participation. The first official MOOC was offered by Stephen Downes and George Siemens at the University of Manitoba in 2008. Since then, the numbers of courses offered and providers have increased rapidly.84


Overview of Current Providers

Today, popular MOOC providers in the postsecondary space include edX, a nonprofit, open-source MOOC platform created by Harvard and MIT that partners with universities and cultural organizations to create courses; Coursera, a proprietary provider with more than a thousand courses from nearly 150 postsecondary schools; and Udacity, which partners with companies such as Google and Apple to teach skills that are in particularly high demand at these companies (in many ways, these courses are a form of employer-provided training).85 Each of these providers offered its first courses in 2011 or 2012. The expansion and the excitement that surrounded this emergence led some to call 2012 the “year of the MOOC.”86

Since 2012, MOOC offerings, enrollments, and providers have continued to grow. In March 2012, 11 MOOCs were offered. In March 2015, 2,400 MOOCs were offered by faculty at about 400 universities, and roughly 17 million students had enrolled. In March 2016, nearly 4,200 MOOCs were offered by faculty at about 500 universities, and 35 million students had enrolled (see Figure 6).87 Because platforms that host MOOCs like edX and Coursera emerge frequently, finding an accurate count is difficult, though one plausible estimate for 2015, provided by Class Central, is 80.88


Figure 6: Increases in MOOC Offerings, March 2012 to March 2016

Figure 6: Increases in MOOC Offerings, March 2012 to March 2016

Source: “By the Numbers: MOOCs in 2015,” Class Central, https://www.class-central.com/report/moocs-2015-stats/; “State of the MOOC 2016: A Year of Massive Landscape Change for Massive Open Online Courses,” Online Course Report (2016), http://www.onlinecoursereport.com/state-of-the-mooc-2016-a-year-of-massive-landscape-change-for-massive-open-online-courses/.

Despite their growth, claims that MOOCs would revolutionize undergraduate postsecondary education have not yet come to fruition. MOOC course completion rates are extremely low; approximately 6 percent of those who start a course complete it. For those who start a course with the intention to finish, completion rates are a bit higher, at 22 percent.89 This low completion rate may be due, in part, to who enrolls in the courses. Most MOOC users are already well-educated and may be browsing courses for specific information or enrichment. At least 70 percent of enrollees have one or more degree, and most students are between the ages of 25 and 40.90

Still, learners do seem to value the MOOCs they take. In 2015, Coursera surveyed 52,000 respondents who had taken MOOCs on the Coursera platform. Fifty-two percent of respondents indicated that career benefits were their primary reason for enrolling in a MOOC, and, of those, 33 percent reported that they had realized tangible career benefits. Slightly larger shares of respondents without bachelor’s degrees reported these sorts of benefits.91


Intersections and Future Directions

As the initial excitement around MOOCs has died down, providers have also developed new strategies to make their offerings valuable. In 2014 and 2015, some MOOC providers began bundling courses into specializations or “nano­degrees.” These course series result in a digital badge or certificate, which completers can display on social media and share with employers. They tend to be in high-demand areas that will help participants advance in their careers and increase their earning potential. For example, in a model that borrows from trade schools, industry certification programs, and bootcamps, Udacity works with prominent technology companies to develop and offer micro-credentials they call “nanodegrees” in fields like data science, programming, iOS, and Android development. Udacity also provides its learners with personalized career support, and offers a “premium” option with a job placement guarantee. Rather than charge by course or credential, Udacity charges premium subscribers $200–$300 monthly for unlimited access, and students can complete a nanodegree as quickly or slowly as they like.92

MOOC providers have also begun partnering with colleges and universities to offer portions of degree programs. Arizona State University’s Global Freshman Academy (GFA), which had a soft launch in 2015, allows any student in the world to take freshman classes on the edX platform for $200 a credit (charged only after they pass the course). Students can take individual courses that count toward a degree, and if they finish a series of eight GFA courses, they earn full credit for their freshman year at ASU for roughly half the cost of the average annual in-state tuition at a public university. Students can go on to enroll as sophomores at ASU or transfer the credits to any institution that accepts ASU credits. Currently, financial aid is not available to GFA students, and the program is too nascent to have produced any reportable outcomes.93 Similar programs exist at the graduate level, notably MIT’s supply chain master’s degree program and Georgia Tech’s online master of science degree in computer science.94

MOOCs are increasingly being recognized as alternative pathways to a degree. In October 2015, edX was approved as a provider by the ACE Alternative Credit project. As a result, students who pass approved courses on the edX platform can use them as transferable general education credits at participating colleges and universities.95 StraighterLine, a provider of low-cost online courses developed by publishers, is also accredited by the ACE Alternative Credit project, as well as the Distance Education Accrediting Council, and its courses provide transferable credit to more than 100 colleges and universities.96 StraighterLine has also partnered with the Dallas County Community College District to offer pathways to Associate of Science in Business and Associate of Arts in Criminal Justice degrees. The program, which was selected for an EQUIP partnership, costs $99 per credit (with materials) and allows students to complete up to 75 percent of their coursework by taking StraighterLine Courses.


Competency-Based Education

In the broadest sense, competency-based programs offer an alternative pathway to a degree by awarding academic credit when students demonstrate competency in designated learning outcomes rather than when they pass courses that meet requirements for instructional time. Generally, one of two approaches to competency-based education is followed: a credentialing approach that awards students academic credit based on assessment of their prior learning, independent of the program; and an instructional approach, in which students are taught material on a more flexible schedule than that of traditional academic programs, with the aim of achieving the competency-based learning outcomes. In lieu of instructors, students are often guided through their learning by a coach or mentor. Programs that take the instructional approach culminate in certificates, associate’s degrees, and bachelor’s degrees, and the most common areas of study are business, education, health care, and engineering.97 Many programs combine both credentialing and instructional approaches.


History

Though competency-based learning and credentialing are often characterized as innovative, they have a long history. Since the end of World War I, institutions have awarded credit for military training and experiences. After World War II and through the 1970s, institutions and coordinating organizations created standardized exams to award credit, such as the Advanced Placement (AP) program, which awards college credit for passing standardized exams based on high school course work, and the College-Level Examination Program (CLEP), which validates mastery of a subject through independent study, prior coursework, or out-of-class experiences.98 Organizations such as the American Council on Education and the Council for Adult and Experiential Learning and the National College Credit Recommendation Service also began to review extra-institutional experiences and provide recommendations to colleges and universities on how to award credit.

Instructional programs that allow students to progress based on demonstrated competence rather than classroom time have also existed for decades. For example, in the 1970s, Empire State College and other institutions began to offer adult students “learning contract” programs in which remote students worked with a mentor to develop a personalized learning plan for their education. These plans specified learning objectives, assessment procedures, and learning activities, such as independent study, internships, correspondence courses, travel, or even face-to-face courses at another institution. Programs usually culminated in a bachelor’s degree.99 Western Governors University, which was founded in 1998, is often marked as the first modern competency-based institution to take a fully realized instructional approach.100


Overview of Current Providers

The credentialing approach to competency-based education is widespread in postsecondary education. Most colleges and universities accept credit for AP and International Baccalaureate tests, and 2,900 colleges and universities accept credit through CLEP.101 Some online and traditional universities accept college credit through DANTES Subject Standardized Tests, which were developed by the U.S. Department of Defense for military members and families but are also available to other nontraditional students.102 In addition, the American Council on Education’s College Credit Recommendation Service provides recommendations to 2,000 colleges and universities on how to award credit for more than 35,000 nonuniversity courses, exams, apprenticeships, and other forms of nontraditional training. The National College Credit Recommendation Service translates training and education programs into college credit equivalencies for 1,500 postsecondary institutions.103

The instructional approach is far less common. According to one study with strict definitional criteria, at least 34 schools offer self-paced programs.104 Some institutions, such as Western Governors University, offer only competency-based programs, while other institutions offer these along with traditional programs. These include Southern New Hampshire University’s College for America, Capella University, and the University of Wisconsin’s UW Flexible Option. Tuition models also vary across schools and programs. Western Governors University offers a buffet model in which students pay a flat, six-month fee to take as many subjects (and assessments) as they want. In most other programs, students pay on a per credit basis. Because of this variation and deviation from the credit-hour model, competency-based programs require exemptions from the standard rules to be eligible to receive federal financial aid.105

Other programs that take the instructional approach incorporate competency-based elements into their curricula but maintain the traditional seat-time model and credit-hour structure, so they are self-paced only within a traditional term and are eligible for aid. Using this broader definition, Eduventures counted 150 programs that incorporated some sort of competency-based framework, serving as many as 200,000 students (up from 50,000 in 1990).106

Perhaps because of their flexibility and recognition of prior learning, competency-based programs are particularly popular among older learners. At nine institutions closely analyzed in a 2015 American Enterprise Institute report, 38 percent of students were between the ages of 25 and 34, and 40 percent were between the ages of 35 and 49. Only 1 percent of enrolled students were first-time, full-time undergraduates, and 26 percent received Pell Grants. However, because not all degree programs at these institutions are eligible to receive financial aid, Pell Grant eligibility may be a poor measure of low-income student enrollment for these types of programs.107

Little data are available on outcomes for competency-based education programs. At the nine institutions analyzed in the American Enterprise Institute report, average six-year completion rates were 17 percent—more than 40 percentage points lower than the national average six-year completion rate for first-time, full-time undergraduates at Title IV schools. Of course, this compares two poorly matched groups, and completion rates vary by institution. For example, Western Governors University reports that among the 86 percent of students at the university who are 25 or older, just under 37 percent graduate within six years. This is about 10 percentage points higher than the national graduation rate for the age group.108


Future Directions and Intersections

One major obstacle to the expansion of competency-based programs is the fact that federal financial aid typically cannot be used for programs or assessment fees. The buffet-style tuition pricing model offered by institutions like Western Governors University holds promise for motivated students but penalizes those who move too slowly through their courses, which is common for adult learners who take online courses.109

However, these restrictions are slowly beginning to erode. In 2005, Congress included a “direct assessment” provision in its reauthorization of the Higher Education Act, which allows programs that use direct assessment to measure competencies to be eligible for federal financial aid (however, programs are eligible only if they translate competencies into credit hours on a student’s transcript).110 More recently, as part of an experimental sites initiative in 2014, the U.S. Department of Education selected 40 colleges and universities to receive waivers from aid eligibility rules as they experimented with competency-based education and prior-learning assessment. Many of these colleges were part of a Lumina Foundation–funded group called the Competency-Based Education Network, which also provides resources to institutions to help them meet the requirements for receiving aid.111

Other institutions continue to work within the credit-hour framework while borrowing elements of curriculum design from direct assessment and other competency-based approaches. For example, the University of Maryland University College (UMUC) is redesigning its entire curriculum with a competency-based framework, so that each program will cohere around employer-informed competencies, learning activities, and assessments. UMUC is also prototyping a competency-based transcript to better match this academic model, and is experimenting with ways to incorporate self-paced options within the constraints of the semester. Similarly, in redesigning remedial math and English courses, many community colleges, including most schools within the North Carolina Community College System, have broken course content into one-unit modules through which students progress at their own pace.112

Finally, institutions are starting to work in a coordinated fashion to establish competencies—rather than the credit hour—as the currency of transfer.113 The Lumina Foundation has outlined a framework for “connecting credentials” across multiple institutional contexts, and funds initiatives that translate various credentials into a common set of competencies.114 A group of community colleges recently began an initiative called “Right Signals” that is implementing Lumina’s credentials framework to recognize and verify the multiple experiences and credentials with which many of their students matriculate.115


ENDNOTES

23. Anthony Carnevale and colleagues at the Georgetown Center for Education and the Workforce estimate the total number of certificates awarded from Title IV and non-Title IV institutions as roughly 1 million in 2010. The authors estimate that only 300,000 certificates were awarded in 1994. See Anthony P. Carnevale, Stephen J. Rose, and Andrew R. Hanson, “Certificates: Gateway to Gainful Employment and College Degrees,” Center on Education and the Workforce (June 2012), https://cew.georgetown.edu/wp-content/uploads/2014/11/Certificates.FullReport.061812.pdf. Estimates are based on the Survey of Income Program Participation and the National Longitudinal Survey of Youth. See also, Anthony Carnevale and Jamie Merisotis, “An Important Measure of Education,” Politico (July 31, 2012), http://www.politico.com/story/2012/07/the-importance-of-post-secondary-certificates-079223.

24. Stephanie Ewert and Robert Kominski, “Measuring Alternative Credentials: 2012,” Household Economic Studies, United States Census Bureau (January 2014), https://www.census.gov/prod/2014pubs/p70-138.pdf.

25. “Army COOL: Credentialing Opportunities Online,” https://www.cool.army.mil/search/CredSearchAlpha.htm.

26. See Cassandria Dortch, “Carl D. Perkins Career and Technical Education Act of 2006: Background and Performance,” Congressional Research Service, https://fas.org/sgp/crs/misc/R42863.pdf; “Carl D. Perkins Career and Technical Education Act of 2006,” Advance CTE, https://www.careertech.org/perkins.

27. The National Center for Education Statistics breaks these programs down into ten broad categories: agriculture and natural resources; business and marketing; communications and design; computer and information sciences; consumer services education; engineering and architecture; health sciences; manufacturing, construction, repair, and transportation; protective services; and public, legal, and social services. In 2013, more than one third of certificates awarded were in the health sciences.

28. See Carnevale, Rose, and Hanson, “Certificates: Gateway to Gainful Employment and College Degrees”; U.S. Department of Education, National Center for Education Statistics, Integrated Postsecondary Education Data System (IPEDS) Institutional Characteristics (IC) and Completions Components, 2013, “Table P130: Percentage distribution of credential-seeking undergraduates within each credential goal and curriculum area, by sex and age: 2011–12,” https://nces.ed.gov/surveys/ctes/tables/p130.asp.

29. Congress passed the Morrill Acts in 1862 and 1890, establishing land-grant support for colleges with a focus on vocational fields. In 1917, the Smith-Hughes Act set the foundation for a modern vocational education system in public secondary and postsecondary schools, with curriculum and funding that were separate from academic programs. See Brewer, “The History of Career and Technical Education.”

30. See Suzanne Mettler, Soldiers to Citizens: The G.I. Bill and the Making of the Greatest Generation (New York: Oxford University Press, 2005).

31. A. J. Angulo, Diploma Mills: How For-Profit Colleges Stiffed Students, Taxpayers, and the American Dream (Baltimore: John Hopkins University Press, 2016); “CC Growth Over Past 100 Years,” American Association of Community Colleges, http://www.aacc.nche.edu/AboutCC/history/Pages/ccgrowth.aspx. See also “Higher Education for American Democracy, Volume 1: Establishing the Goals,” A Report of the President’s Commission on Higher Education (December 1, 1947), 67–70, https://babel.hathitrust.org/cgi/pt?id=uc1.31158001076040;view=1up;seq=5; Philo A. Hutchenson, “The Truman Commission’s Vision of the Future,” Thought and Action (2007), http://www.nea.org/assets/img/PubThoughtAndAction/TAA_07_11.pdf.

32. Angulo, Diploma Mills: How For-Profit Colleges Stiffed Students, Taxpayers, and the American Dream; Doug Lederman and Paul Fain, “Boom, Regulate, Cleanse, Repeat: For-Profit Colleges: Slow but Inevitable Drive toward Acceptability,” in Remaking College: The Changing Ecology of Higher Education, ed. Michael W. Kirst and Mitchell L. Stevens (Stanford, Calif.: Stanford University Press, 2015), 61–83.

33. Carnevale, Rose, and Hanson, “Certificates: Gateway to Gainful Employment and College Degrees”; Complete College America, “Certificates Count: An Analysis of Sub-Baccalaureate Certificates”; Ewert and Kominski, “Measuring Alternative Credentials: 2012.”

34. These schools educated roughly 670,000 students each year. Cellini and Goldin found that for-profit schools that are not Title IV eligible charge tuition rates that are significantly lower than those charged by Title IV–eligible schools. They also found that students in programs in those schools have completion rates and certification exam performance that are similar to students at analogous programs at Title IV–eligible institutions. See Cellini and Goldin, “Does Federal Student Aid Raise Tuition? New Evidence on For-Profit Colleges.”

35. U.S. Department of Education, National Center for Education Statistics, Integrated Postsecondary Education Data System (IPEDS) Institutional Characteristics (IC) and Completions Components, 2013, “Table P150. Number of Title IV postsecondary institutions that offer sub-baccalaureate occupational education certificate programs, by control and level of institution and detailed field of study: United States, 2013,” https://nces.ed.gov/surveys/ctes/tables/P150.asp.

36. For eligibility, loan payment of a typical graduate must not exceed 20 percent of his or her discretionary income, or 8 percent of his or her total earnings. U.S. Department of Education, “Fact Sheet: Obama Administration Increases Accountability for Low-Performing For-Profit Institutions,” July 1, 2015, http://www.ed.gov/news/press-releases/fact-sheet-obama-administration-increases-accountability-low-performing-profit-institutions. The Department of Education estimates that as many as 1,400 programs serving 840,000 students would not meet the gainful employment standard.

37. Ashley A. Smith, “U.S. Cuts Off ITT Tech,” Inside Higher Ed (August 26, 2016), https://www.insidehighered.com/news/2016/08/26/education-department-bars-itt-tech-enrolling-new-students-federal-aid.

38. Andy Thomason, “After Losing Aid for New Students, Giant For-Profit ITT Will Close All Its Campuses,” Chronicle.com (September 6, 2016), http://www.chronicle.com/blogs/ticker/after-losing-aid-for-new-students-giant-for-profit-itt-will-close-all-its-campuses/114025. In 2015, another large for-profit chain, Corinthian Colleges, shut down and filed for bankruptcy because of federal fines for misleading employment claims, and in 2016 a federal panel recommended the termination of the Accrediting Council for Independent Colleges and Schools, an accreditor of many for-profit institutions. See Kirk Carapezza, “The Days May Be Numbered for Corinthian Colleges Accreditor,” NPR ED (June 15, 2016), http://www.npr.org/sections/ed/2016/06/15/482181707/the-days-may-be-numbered-for-corinthian-colleges-accreditor.

39. Of 1,028 public two-year institutions, 1,003 offer occupational certificates. U.S. Department of Education, National Center for Education Statistics, Integrated Postsecondary Education Data System (IPEDS) Institutional Characteristics (IC) and Completions Components, 2013, “Table P143. Number and percentage distribution of Title IV postsecondary institutions that offer programs at each undergraduate credential level, overall and for occupational education programs, by level and control of institution: United States, 2013,” https://nces.ed.gov/surveys/ctes/tables/P143.asp.

40. For a comparison of costs, see “Figure 18: Public two-year institutions net costs are lower than private institutions,” in Carnevale, Rose, and Hanson, “Certificates: Gateway to Gainful Employment and College Degrees.” For a comparison of program offerings, see U.S. Department of Education, National Center for Education Statistics, Integrated Postsecondary Education Data System (IPEDS) Institutional Characteristics (IC) and Completions Components, 2013, “Table P150. Number of Title IV postsecondary institutions that offer sub-baccalaureate occupational education certificate programs, by control and level of institution and detailed field of study: United States, 2013,” https://nces.ed.gov/surveys/ctes/tables/P150.asp.

41. U.S. Department of Education, National Center for Education Statistics, IPEDS IC and Completions Components, 2013, “Table P150. Number of Title IV postsecondary institutions that offer sub-baccalaureate occupational education certificate programs, by control and level of institution and detailed field of study: United States, 2013,” https://nces.ed.gov/surveys/ctes/tables/P150.asp.

42. “For-Profit College Sector Continues to Shrink,” Inside Higher Ed (July 15, 2016), https://www.insidehighered.com/quicktakes/2016/07/15/profit-college-sector-continues-shrink.

43. One analysis of labor outcomes in Kentucky found that completers of one-year certificate programs earned nearly as much as associate’s degree completers, and that men increased their earnings by 40 percent and women increased their earnings by 20 percent. The same study found that men who completed programs that lasted for less than one year increased earnings by only 10 percent, and women in shorter-term programs increased earnings by only 3 percent. Ewert and Kominski, “Measuring Alternative Credentials: 2012,” https://www.census.gov/prod/2014pubs/p70-138.pdf.

44. Complete College America, “Certificates Count: An Analysis of Sub-Baccalaureate Certificates.” See Meyer and Bacon, “The Need for a National Certification Ecosystem.”

45. Angela Hanks, “Making Pell Work: How America’s $30 Billion in Need-Based College Aid Can Be More Job-Driven,” National Skills Coalition (July 2015), http://www.nationalskillscoalition.org/resources/publications/file/2015-07-Making-Pell-Work-How-Americas-30-Billion-Investment-in-Need-Based-College-Aid-Can-Be-More-Job-Driven.pdf.

46. “Experimental Sites,” Federal Student Aid, https://experimentalsites.ed.gov/exp/approved.html.

47. Students may already be “stacking” credentials, with and without coordinated efforts to ease the process. For example, in one analysis, 4.8 percent of students who initially earned a less-than-one-year certificate went on to earn a longer-term certificate within six years; 35.7 percent went on to earn an associate’s degree; and 9.5 percent transferred to a four-year institution. Only 2.4 earned a bachelor’s degree within six years of earning an initial short-term certificate. Degree attainment for long-term certificate holders is less, suggesting that short-term certificates, which tend to have lower earning outcomes when they are an individual’s highest level of educational attainment, may have more potential as stackable credentials. See “Loss/Momentum Framework (LMF) Completion State: Model Analysis-Stacking Credentials,” Completion by Design, http://www.completionbydesign.org/our-approach/step-3-diagnose-the-issues/pathway-analyses-toolkit/pinpointing-where-improvements-are-needed/lmf-completion-stage/model-analysis-%E2%80%93-stacking-credentials.

48. See James T. Austin, Gail O. Mellow, Mitch Rosin, and Marlene Seltzer, “Portable, Stackable Credentials: A New Education Model for Industry-Specific Career Pathways,” McGraw Hill Research Foundation (November 28, 2012), http://www.jff.org/sites/default/files/publications/materials/Portable%20Stackable%20Credentials.pdf; Evelyn Ganzglass, “Scaling ‘Stackable Credentials:’ Implications for Implementation and Policy,” Center for Postsecondary and Economic Success (March 2014), http://www.clasp.org/resources-and-publications/files/2014-03-21-Stackable-Credentials-Paper-FINAL.pdf.

49. “Connecting Credentials: A Beta Credentials Framework,” Lumina Foundation (June 11, 2015), https://www.luminafoundation.org/resources/connecting-credentials.

50. Meyer and Bacon, “The Need for a National Certification Ecosystem,” http://evolllution.com/programming/credentials/the-need-for-a-national-certification-ecosystem/.

51. In 1982, John H. Patterson created the National Cash Register Primer and other rigorous management techniques to train company salesmen, and Taylorism and Fordism gained popularity as forms of training and management in the early decades of the twentieth century. For a timeline with more details, see Di Lewis, “The History of Training and Development” [Infographic], AllenComm, http://www.allencomm.com/blog/2016/04/history-training-development-infographic/.

52. “2015 Training Industry Report,” Training Magazine (2015), https://trainingmag.com/trgmag-article/2o15-training-industry-report.

53. See Lerman, McKernan, and Riegg, “The Scope of Employer-Provided Training in the United States: Who, What, Where, and How Much?”

54. Jennifer Friendmann, “Jiffy Lube Recognized for Superior Training Program, Dedication to Employee Development,” Jiffy Lube News & Press (February 7, 2012), https://www.jiffylube.com/news-and-press/jiffy-lube174-recognized-for-superior-training-program-dedication-to-employee-development; “Jiffy Lube Technicians,” Jiffy Lube, https://www.jiffylube.com/about/technicians.

55. Onshore Outsourcing, http://onshoreoutsourcing.com/; Selingo, College Unbound: The Future of Higher Education and What It Means for Students, 163.

56. Some programs of this type are privately funded. Boeing, for example, pays manufacturing companies to provide 10–15 weeks of on-the-job training to unemployed workers, with an expectation that trainees continue on as full-time employees at the company at which they are trained. See Deborah Kobes, “Making On-the-Job Training Work: Lessons from the Boeing Manufacturing On-the-Job Training Project,” Jobs for the Future (November 2013), http://www.jff.org/sites/default/files/publications/materials/NFWS_MakingOnTheJobTrainingWork_110413.pdf.

57. See Indivar Dutta Gupta, Kali Grant, Matthew Eckel, and Peter Edelman, “Lessons Learned from 40 Years of Subsidized Employment Programs: A Framework, Review of Models, and Recommendations for Helping Disadvantaged Workers,” Georgetown Center of Poverty and Inequality (Spring 2016), https://www.law.georgetown.edu/academics/centers-institutes/poverty-inequality/current-projects/upload/GCPI-Subsidized-Employment-Paper-20160413.pdf; “What Works in Job Training: A Synthesis of the Evidence,” U.S. Department of Labor (July 22, 2014), https://www.dol.gov/asp/evaluation/jdt/jdt.pdf.

58. “Data and Statistics,” Apprenticeship USA, https://www.doleta.gov/oa/data_statistics.cfm.

59. See “What Works in Job Training: A Synthesis of the Evidence,” https://www.dol.gov/asp/evaluation/jdt/jdt.pdf.

60. See Terry Grobe, Nancy Martin, and Andrea Steinberg, “Creating Pathways to Employment: The Role of Industry Partnerships in Preparing Low-Income Young Adults for Careers in High-Demand Industries,” National Fund for Workforce Solutions (June 2015), https://nationalfund.org/wp-content/uploads/2016/10/Creating-Pathways-to-Employment-073015.pdf.

61. ASSET Datasheet, New Ford Tech, https://www.newfordtech.com/assets/pdf/Datasheet-ASSET.pdf.

62. “Cisco Learning Network,” Cisco, https://learningnetwork.cisco.com/welcome.

63. See “Accumold Scholars,” http://www.accumoldscholars.com/; Rob Denson and Karen Stiles, “Empty Seats, Open Jobs, Know More,” in STEMconnector, Advancing a Jobs-Driven Economy: Higher Education and Business Partnerships Lead the Way (New York: Morgan James Publishing, 2015), 54–59.

64. Apprenticeship 2000, http://apprenticeship2000.com/zwp/.

65. Amanda Ripley, “The Upwardly Mobile Barista,” The Atlantic Monthly (May 2016), http://www.theatlantic.com/magazine/archive/2015/05/the-upwardly-mobile-barista/389513/; “JetBlue Takes Fresh Approach to Employer-Sponsored Education with Launch of JetBlue Scholars,” Business Wire (April 18, 2016), http://www.businesswire.com/news/home/20160418006299/en/JetBlue-Takes-Fresh-Approach-Employer-Sponsored-Education-Launch.

66. See “About FISC,” Farm and Industry Short Course, College of Agricultural and Life Sciences, University of Wisconsin-Madison, https://fisc.cals.wisc.edu/about-fisc/.

67. “Institute of Meatpacking: 1923–1928,” University of Chicago University of Extension Records, https://www.lib.uchicago.edu/ead/pdf/ofcpreshjb-0052-002-03.pdf.

68. “The Vocational Age Emerges,” Association for Career and Technical Education, https://www.acteonline.org/uploadedFiles/Assets_and_Documents/Global/files/CTE_Info/Research/Vocational-Age-Emerges_1876-1926.pdf.

69. Liz Eggleston, “2016 Coding Bootcamp Market Size Study,” Course Report (June 2016), https://www.coursereport.com/reports/2016-coding-bootcamp-market-size-research.

70. See “Executive Education: Short Course,” NYU Stern, http://www.stern.nyu.edu/programs-admissions/executive-education/short-courses/overview/what-are-short-courses.

71. Eggleston, “2016 Coding Bootcamp Market Size Study”; Goldie Blumenstyk, “As Coding Bootcamps Grow, One Tries a Nonprofit Model,” The Chronicle of Higher Education (August 2, 2016), http://chronicle.com/article/As-Coding-Boot-Camps-Grow-One/237329.

72. Eggleston, “2016 Coding Bootcamp Market Size Study.”

73. Liz Eggleston, “2015 Coding Bootcamp Alumni & Demographics Study,” Course Report (October 25, 2015), https://www.coursereport.com/reports/2015-coding-bootcamp-job-placement-demographics-report#Table1.

74. Ibid.

75. Stuart Zweben and Betsy Bizot, “2014 Taulbee Survey,” Computing Research Association (July 2015), http://cra.org/crn/wp-content/uploads/sites/7/2015/06/2014-Taulbee-Survey.pdf.

76. Eggleston, “2015 Coding Bootcamp Alumni & Demographics Study.”

77. Ibid.; Zweben and Bizot, “2014 Taulbee Survey.”

78. Eggleston, “2015 Coding Bootcamp Alumni & Demographics Study”; Alex Williams, “Coding Bootcamp vs. College,” Course Report (September 16, 2015), https://www.coursereport.com/blog/coding-bootcamp-vs-college.

79. See Emily Deruy, “Financial Aid Now Pays for Coding Bootcamps and MOOCs,” The Atlantic (October 14, 2015), http://www.theatlantic.com/politics/archive/2015/10/financial-aid-now-pays-for-coding-bootcamps-and-moocs/433116/; “FACT SHEET: ED Launches Initiative for Low-Income Students to Access New Generation of Higher Education Providers,” U.S. Department of Education Press Release (August 16, 2016), http://www.ed.gov/news/press-releases/fact-sheet-ed-launches-initiative-low-income-students-access-new-generation-higher-education-providers.

80. Maxine Joselow, “Coding Goes Mainstream,” Inside Higher Ed (August 10, 2016), https://www.insidehighered.com/news/2016/08/10/traditional-colleges-enter-coding-boot-camp-market.

81. Ray Batra, “What Happens When Universities and Bootcamps Join Forces?” EdSurge (May 10, 2016), https://www.edsurge.com/news/2016-05-10-what-happens-when-universities-and-bootcamps-join-forces. Like enrollees at most analytics and data science bootcamps, a large share of Level students already hold advanced degrees.

82. Justin Pope, “What Are MOOCs Good For?” MIT Technology Review (December 15, 2014), https://www.technologyreview.com/s/533406/what-are-moocs-good-for/.

83. “By the Numbers: MOOCs in 2015,” Class Central, https://www.class-central.com/report/moocs-2015-stats/; “State of the MOOC 2016: A Year of Massive Landscape Change for Massive Open Online Courses,” Online Course Report (2016), http://www.onlinecoursereport.com/state-of-the-mooc-2016-a-year-of-massive-landscape-change-for-massive-open-online-courses/.

84. Juliana Marques, “A Short History of MOOCs and Distance Learning,” MOOC News and Reviews (April 17, 2013), http://moocnewsandreviews.com/a-short-history-of-moocs-and-distance-learning/.

85. For a list of common providers, see “By the Numbers: MOOCs in 2015.”

86. See, for example, Laura Pappano, “The Year of the MOOC,” The New York Times (November 2, 2012).

87. “By the Numbers: MOOCs in 2015.”

88. Of these providers, Coursera captures the largest share of the market (36.5 percent); edX the next largest (17.1 percent); and Canvas.net, a new player on the field, captures 6.92 percent. (Udacity captures only 2.95 percent of the market but because of its specialized focus and innovative model, has received disproportionate attention.) “By the Numbers: MOOCs in 2015.”

89. Based on a survey and log data from nine HarvardX courses. See Justin Reich, “MOOC Completion and Retention in the Context of Student Intent,” Educause Review (December 8, 2014), http://er.educause.edu/articles/2014/12/mooc-completion-and-retention-in-the-context-of-student-intent. More promisingly, 85 percent of participants who took a MOOC through Microsoft, AT&T, or McKinsey & Company for professional development completed the course. See “State of the MOOC 2016: A Year of Massive Landscape Change for Massive Open Online Courses,” Online Course Report (2016), http://www.onlinecoursereport.com/state-of-the-mooc-2016-a-year-of-massive-landscape-change-for-massive-open-online-courses/.

90. Ho, Chuang, Reich, et al., “HarvardX and MITx: Two Years of Open Online Courses.”

91. Chen Zhenghao, Brandon Alcorn, Gayle Christensen, Nicholas Eriksson, Daphne Koller, and Ezekial K. Emanuel, “Who’s Benefiting from MOOCs, and Why,” Harvard Business Review (September 22, 2015), https://hbr.org/2015/09/whos-benefiting-from-moocs-and-why; “Coursera Study Shows Positive Career and Educational Outcomes for Learners,” Coursera Blog (September 22, 2015), http://coursera.tumblr.com/post/129636349192/coursera-study-shows-positive-career-and.

92. Dhawal Shah, “Udacity’s Nanodegree Plus Comes with a Job Guarantee,” Class Central (January 25, 2016), https://www.class-central.com/report/udacitys-nanodegree-plus-comes-job-guarantee/; “Nanodegree Programs,” Udacity, https://www.udacity.com/nanodegree.

93. See “Global Freshman Academy,” http://gfa.asu.edu/; Charles Huckabee, “Arizona State and edX Will Offer an Online Freshman Year, Open to All,” Chronicle of Higher Education (April 23, 2015), http://www.chronicle.com/blogs/ticker/arizona-state-and-edx-will-offer-an-online-freshman-year-open-to-all/97685.

94. Carl Straumsheim, “MIT’s New Model,” Inside Higher Ed (October 8, 2015), https://www.insidehighered.com/news/2015/10/08/massachusetts-institute-technology-launch-half-mooc-half-person-masters-degree; Carl Straumsheim, “Georgia Tech’s Next Steps,” Inside Higher Ed (April 27, 2016), https://www.insidehighered.com/news/2016/04/27/georgia-tech-plans-next-steps-online-masters-degree-computer-science.

95. The ACE Alternative Credit Project was launched in October of 2015, when ACE selected 111 free or low-cost courses offered by nontraditional providers to approve for credit recommendation at about three dozen institutions. See “ACE Picks Courses for Alternative Credit Project,” Inside Higher Ed (October 22, 2015), https://www.insidehighered.com/quicktakes/2015/10/22/ace-picks-courses-alternative-credit-project.

96. Alison Dulin Salisbury, “EdX Stays Committed to Universities, Offering Credits for MOOCs,” EdSurge (November 23, 2015), https://www.edsurge.com/news/2015-11-23-edx-buckles-down-to-offer-credit-for-moocs.

97. For a good overview of competency-based education and its broad definition, see Robert Kelchen, “The Landscape of Competency Based Education: Enrollments, Demographics, and Affordability,” American Enterprise Institute Series on Competency-Based Higher Education (January 2015), https://www.luminafoundation.org/files/resources/competency-based-education-landscape.pdf. See also Cecilia Le, Rebecca E. Wolfe, and Adria Steinberg, “The Past and the Promise: Today’s Competency Education Movement,” Jobs for the Future (September 2014), http://www.jff.org/sites/default/files/publications/materials/The-Past-The-Promise-091514.pdf; Preston Cooper, “Mastering the Skills, Not the Clock,” US News (February 17, 2016), http://www.usnews.com/opinion/knowledge-bank/2016/02/17/the-approaching-revolution-of-competency-based-higher-education.

98. See Kelchen, “The Landscape of Competency Based Education: Enrollments, Demographics, and Affordability”; “Facts about WGU”; “2900 Colleges and Universities,” CLEP, The College Board, https://clep.collegeboard.org/search/colleges.

99. Kate Ford, “Competency-Based Education: History, Opportunities, Challenges,” University of Maryland University College Center for Innovation in Learning and Student Success (October 24, 2014), https://www.umuc.edu/innovatelearning/upload/cbe-lit-review-ford.pdf; Cross, “An Introduction to Non-Traditional Education in the United States.”

100. Ford, “Competency-Based Education: History, Opportunities, Challenges.”

101. See Kelchen, “The Landscape of Competency Based Education: Enrollments, Demographics, and Affordability”; “Facts about WGU”; “2900 Colleges and Universities.” CLEP, The College Board, https://clep.collegeboard.org/search/colleges.

102. “Earning College Credit with DANTES Subject Standardized Tests,” eLearners, http://www.elearners.com/military-friendly-colleges/earning-college-credit-with-dantes/. Other competency-based assessments that can be used for credit include the Excelsior College Examination Program and Thomas Edison Exam by Credit program, both of which can be used for transfer credit outside of these institutions.

103. See “The ACE CREDIT College and University Network,” American Council on Education, http://www.acenet.edu/news-room/Pages/The-ACE-CREDIT-College-and-University-Network.aspx.

104. Kelchen, “The Landscape of Competency Based Education: Enrollments, Demographics, and Affordability”; “Facts about WGU.”

105. Kelchen, “The Landscape of Competency Based Education: Enrollments, Demographics, and Affordability.”

106. Brian Fleming, “Mapping the Competency-Based Education Universe,” Eduventures (February 17, 2015), http://www.eduventures.com/2015/02/mapping-the-competency-based-education-universe/.

107. Ibid.

108. See “WGU’s Graduation Rates,” Western Governors University, http://www.wgu.edu/tuition_financial_aid/brief_guide#.

109. For a more robust analysis of costs, see Kelchen, “The Landscape of Competency Based Education: Enrollments, Demographics, and Affordability.”

110. Stephen R. Porter, “Competency-Based Education and Federal Student Aid,” Competency-Based Education Network (March 2014), http://www.cbenetwork.org/sites/457/uploaded/files/Competency_Based_Education_and_Federal_Student_Aid.pdf.

111. Paul Fain, “Experimenting with Competency,” Inside Higher Ed (January 13, 2015), https://www.insidehighered.com/news/2015/01/13/feds-move-ahead-experimental-sites-competency-based-education.

112. See Jessie Brown and Deanna Marcum, “Serving the Adult Student at University of Maryland University College,” Ithaka S+R (June 9, 2016), http://www.sr.ithaka.org/wp-content/uploads/2016/06/SR_Case_Study_Serving_Adult_Student_UMUC_060916.pdf; Jessie Brown and Richard Spies, “Reshaping System Culture at the North Carolina Community College System,” Ithaka S+R (September 10, 2015), http://www.sr.ithaka.org/wp-content/uploads/2015/09/SR_Case_Study_Reshaping_System_Culture_North_Carolina_Community_College_System091015.pdf.

113. Amy Latinen, “Cracking the Credit Hour,” Competency-Based Education Network (September 2012), http://www.cbenetwork.org/sites/457/uploaded/files/Cracking_the_Credit_Hour_Sept5_0.pdf.

114. “Connecting Credentials: A Beta Credentials Framework,” Lumina Foundation (June 11, 2015), https://www.luminafoundation.org/resources/connecting-credentials.

115. “The Right Signals Initiative,” American Association of Community Colleges, http://www.aacc.nche.edu/Resources/Pages/right_signals.aspx. For more information on the project guidelines, see “Request for Proposals: The Right Signals Initiative,” American Association of Community Colleges, http://www.aacc.nche.edu/Resources/Documents/Right_Signal_RFP2.pdf.