Symposium
| Thank You | Thank you to all who attended the 8th Annual Analytics Symposium. PDFs of the presentations will be posted to this page over the next couple weeks as they are approved and prepped. |
| Date | March 3 – 5, 2010 |
| Theme | Optimizing the Performance of People |
| Location | Gaylord National Resort and Convention Center 201 Waterfront Street National Harbor, MD 20745 |
Quick Jump to Section
Pre-Conference Workshops
Track Legend
Day 1-Wednesday, March 3, 2010
Day 2-Thursday, March 4, 2010
Day 3-Friday, March 5, 2010
Pre-Conference
| PRE-CONFERENCE WORKSHOPS Wednesday, March 3, 2010 – 8:30am – Noon All Times Eastern |
||
| Time | Activity/Description | Presenter |
| 8:30a – Noon | Practitioners Guide to Analyzing Learning and Human Capital Data Training |  Kendall Kerekes Vice-President, Human Capital KnowledgeAdvisors |
| This workshop will provide Talent and L&D practitioners with limited data analysis experience the opportunity to learn basic tips from a statistical and business perspective to better use their data.
Bio: Kendall brings over 10 years of Human Resources Executive experience to KnowledgeAdvisors, along with her project management, strategic planning, leadership development, training evaluation, personnel selection/validation, performance assessment/improvement, and change management experience. Having held senior HR positions at Ameriquest and Indymac Bank, her individual practitioner, business project manager, team leader, and Human Resources executive experience brings a real world perspective to measurement methodologies. Kendall earned an MS in Industrial/Organizational Psychology from California State University of San Bernardino. |
||
| Industry Update Regarding Measurement in Federal Space with Networking |  Jeffrey Berk COO KnowledgeAdvisors Vince Penkala Director, Federal/Public KnowledgeAdvisors |
|
| This workshop will provide public sector attendees with an update on recent measurement projects KnowledgeAdvisors has done within the public sector such as Training Needs Analysis and Impact Reviews.
Bio: Jeff led the Benchmarking Group at Andersen prior to joining KnowledgeAdvisors and he brings a deep level of expertise in measurement and benchmarking. He is responsible for managing the internal and customer facing operations of the business and formulating strategic solutions. Jeff is a certified public accountant and holds an MBA from the University of Chicago and is an Adjunct Professor at Loyola University of Chicago. |
||
Track Legend
| SYMPOSIUM TRACKS | |||
| KnowledgeAdvisors Solutions Track | Expert Series Track | ||
| Government Track | Practitioner Track | ||
| Customer Education/Professional Learning Provider Track | Vendor Track | ||
Day 1 Agenda
| SYMPOSIUM Day #1 Wednesday, March 3, 2010 – Noon – 7:00pm Sessions are subject to change |
||
| Time | Activity/Description | Presenter |
| 1:00p – 1:15p | Opening Remarks |  Kent Barnett CEO & Founder KnowledgeAdvisors |
| Bio: Co-founder and former president of Productivity Point International (PPI), Kent helped grow PPI to over $100 million before it was acquired by Knowledge Universe. Kent has 15 years of training leadership and 9 years of ROI analysis experience. Kent has an MBA from The Kellogg School of Management at Northwestern University. | ||
| 1:15p – 2:15p Keynote |
Lockheed Martin’s approach to Talent Measurement |  Marilyn Figlar Vice President, Leadership & Organizational Development Lockheed Martin |
| Lockheed Martin will describe its strategy and tactics to measure learning and leadership in a global organization amidst transformational change.
Bio: Marilyn oversees all learning, talent and leadership development strategies and programs for the corporation. Marilyn is currently also building an internal organization development consultation and change leadership capability specializing in organizational planning, assessment, and design, to improve organizational effectiveness and performance. Prior to this role, Marilyn was Director, Executive Assessment & Development and was responsible for talent management, high potential leadership development programs, and an internal executive coaching program. |
||
| 2:30p – 3:30p Breakouts |
Emerging Trends and Measurement Models for Informal Learning |  Peggy Parskey Measurement Strategist KnowledgeAdvisors |
| This session will present recent research on current informal learning methods, trends and measurement approaches will be presented.
Bio: Peggy has more than 25 years of experience working with Fortune 500 firms whose needs include business operations improvement, management of change and enhanced measurement processes to demonstrate the effectiveness and value of their services. She has facilitated Human Capital and Learning Strategies and is well versed in organizational design methodologies and organizational change and transition methods, tools and processes. Until 2005, Peggy worked for Hewlett Packard. During her tenure at HP, she was responsible for the global learning strategy, measurement strategy and the implementation of learning evaluation processes, tools, and systems (including MTM). |
||
| Reinventing Measurement for Organizational Changes
Presentation not available. |
 Deb Whitcraft Strategic Performance Manager Center for Leadership Capacity Services |
|
| This session will present a case study on how Center for Leadership Capacity re-architected their measurement solution to meet business and organizational changes and challenges.
Bio: Deb manages strategic performance for the Office of Personnel Management’s executive development offered at the Federal Executive Institute, and the leadership and management learning centers at Shepherdstown, West Virginia and Aurora, Colorado, as well as custom solutions. Her background includes Government and Management Studies through University of Maryland and over twenty years of diverse experience in program and performance management with the private sector, Department of Defense and OPM. |
||
| Generating Motivation and Buy-In: Essential Elements for Producing Measurable Results |  Lance Dublin Chief Solution Architect Dublin Consulting |
|
| This session will provide an inspiring look at what behaviors drive motivation for learning and how L&D professionals need to ensure L&D stakeholders understand, experience and realize value through the learning offering. Lance will describe how measurement can play a role in validating the value received from learning or identifying opportunities to improve when the value falls below expectations.
Bio: Lance Dublin has been an advocate for innovative approaches to learning and change throughout his 30 year career. Lance is an independent management consultant working with organizations worldwide to revitalize learning, implement change, and transform organizations. He specializes in strategy development, high-level program design, and the implementation of corporate learning and organizational change initiatives. |
||
| Using Smart Sheet Evaluation Processes |  Dan McLinden, Ed. D. Asst. Vice-President, Education and Training Department Cincinnati Children’s Hospital Medical Center |
|
| This session presents a case study using consistent and comparable evaluations that measure learning on training evaluations beyond traditional (ex. instructor, course, environment) items.
Bio: Dr. Daniel McLinden has spent more than 20 years applying program planning and evaluation. His work has involved implementing measurement systems, working with planning groups to conceptualize high impact investments and evaluating the outcomes of educational investments. |
||
| Customer Intelligence and You |  Amy Rath Enterprise Solutions Manager KnowledgeAdvisors |
|
| KnowledgeAdvisors will lead a breakout session demonstrating effective methods for reporting on your customer data to better understand your customers and their feedback.
Bio: Amy provides senior project management to professional learning providers. In her role she architects implementations and integrations to help customers collect and analyze business intelligence for their learning operation. |
||
| 4:00p – 4:45p Keynote |
Building a Learning Measurement Dashboard |  Thomas R. Simon VP & Chief Learning Officer CNA Insurance |
| This session will provide an overview of the need for an L&D dashboard and review the dashboard creation process, key dashboard components and how dashboards can help decision-making.
Bio: Tom is an accomplished Human Resources leader with extensive experience in talent management & development, talent acquisition, organization effectiveness, HR strategy, measurement and systems. In his current role as VP & Chief Learning Officer for CNA, Tom is responsible for leadership development, knowledge management and technical training. |
||
| 4:45p – 5:30p Keynote |
Industry Update on Measurement w/Case Examples |  Josh Bersin President Bersin & Associates |
| Josh will present his expert-based opinions, backed by research that provide the audience with a researchers’ view of the talent measurement environment.
Bio: Josh Bersin has worked with hundreds of companies to deliver high-impact employee learning, leadership development, and talent management. In 2001, he founded Bersin & Associates to provide research and advisory services focused on corporate learning. Today, the firm is the “go to” source for learning and HR decision makers seeking product and market data, insight on trends and expert advice on enterprise learning and talent management. Bersin is a frequent speaker at global industry events, is a columnist for Chief Learning Officer magazine, and has been quoted in The Wall Street Journal, BBC Radio’s In Business and on National Public Radio’s Morning Edition. Bersin is also the author of The Training Measurement Book: Best Practices, Proven Methodologies, and Practical Approaches (April 2008, Pfeiffer) and The Blended Learning Book: Best Practices, Proven Methodologies, and Lessons Learned (October 2004, Wylie/Pfeiffer). |
||
Day 2 Agenda
| SYMPOSIUM Day #2 Thursday, March 4, 2010 – 7:30am – 8:00pm Sessions are subject to change |
||
| Time | Activity/Description | Presenter |
| 7:30a – 8:30a Sunrise |
Demonstration of Metrics that Matter | Jeffrey Berk COO KnowledgeAdvisors Sara Chizzo Senior Director, Enterprise Solutions KnowledgeAdvisors |
| KnowledgeAdvisors will provide an overview of its world-class learning and human capital analytics toolset.
Bio: Jeff led the Benchmarking Group at Andersen prior to joining KnowledgeAdvisors and he brings a deep level of expertise in measurement and benchmarking. He is responsible for managing the internal and customer facing operations of the business and formulating strategic solutions. Jeff is a certified public accountant and holds an MBA from the University of Chicago and is an Adjunct Professor at Loyola University of Chicago. Sara is responsible for enterprise sales activities for KnoweldgeAdvisors. Specifically, Sara focuses on some of KnowledgeAdvisors’ most strategic clients and partners on global analytics strategy development and solutions leveraging the Metrics that Matter® (MTM) platform. |
||
 Sunrise Session
|
 Dianne Keefer Sr. Director of World Class Service and Performance Consulting ADP |
|
| Presented by Gold Sponsor AchieveGlobal This session will present how ADP drives organizational change and their approach to create world class service culture. Bio: Dianne is responsible for aligning performance improvement initiatives, including training to enhance service delivery. Since joining ADP in 2003, she has been focused on implementing a communication skills solution that focuses on increasing the service experience, both internally and externally. As a performance consultant, she is passionate about helping organizations realize that training is more than just an event, and that it takes commitment, demonstrated support from leadership and management and a compelling business case to drive change in a company. Recently, ADP was named the #2 Top Training Company on Training |
||
| 8:30a – 9:30a Keynote |
DAU’s Leadership Role in HC Strategy |  Frank J. Anderson, Jr. President Defense Acquisition University |
| DAU will describe its creation of a human capital strategy, its key elements, and how it communicated to executes that strategy. The presentation also will emphasize the current and future measurement against the strategy.
Bio: Mr. Anderson is a retired Brigadier General, United States Air Force. Mr. Anderson and the DAU organization have won many awards including Best Corporate Univeristy. Mr. Anderson supports the Under Secretary, Acquisition, Technology and Logistics in executing department-wide Defense acquisition workforce strategic planning, policy and program responsibilities. |
||
| 9:45a – 10:45a Breakouts |
Six Sigma Approach to Measurement Maturity | Jeffrey Berk COO KnowledgeAdvisors |
| Jeffrey will present an overview of the Performance Optimization Framework using Six Sigma principles to measure human capital effectiveness.
Bio: Jeff led the Benchmarking Group at Andersen prior to joining KnowledgeAdvisors and he brings a deep level of expertise in measurement and benchmarking. He is responsible for managing the internal and customer facing operations of the business and formulating strategic solutions. Jeff is a certified public accountant and holds an MBA from the University of Chicago and is an Adjunct Professor at Loyola University of Chicago. |
||
| What GPO is doing for Measuring Learning | Eve Princler Director, Workforce Development, Education and Training Government Printing Office |
|
| GPO will discuss the need for measurement of learning and how it has conducted measurement such as day to day evaluation and a training needs assessment. Challenges, benefits and lessons learned will be discussed.
Bio: Eve L. Princler, MS, MBA, MT (ASCP) SBB,CQM/OE (ASQ) is the Director of Workforce Development, Education and Training at U.S. Government Printing Office where she oversees all workforce development and education initiatives of the Agency. Ms. Princler has extensive background and knowledge in the areas of education and training, business administration and development, transfusion medicine and pathology. She serves as adjunct Assistant Professor of Pathology at George Washington University and is the currently the Founder and Chief Executive Officer of Volaris Systems and Consulting, Inc. a medical technology consulting firm. |
||
| Why ROI is Controversial and Why It is Worth the Controversy |  Jack J. Phillips, Ph.D. ROI Institute |
|
| Dr. Phillips will lead a focused discussion on why ROI is a controversial topic but also why ROI is needed now more than ever. The session will also explore how to overcome the controversy and focus on accountability.
Bio: As a world-renowned expert on measurement and evaluation, Jack J. Phillips is chairman of the ROI Institute. Through the Institute, Phillips provides consulting services for Fortune 500 companies and major global organizations. The author or editor of more than 50 books, he has conducted workshops and presented at conferences in 44 countries. |
||
| How Steelcase is Evolving its Talent Measurement
Presentation not available |
 Faye Richardson-Green Director of Global Learning and Development Steelcase |
|
| This session will present review the major measurement milestones at Steelcase University and how Steelcase continuously improves through measurement.
Bio: Faye Richardson-Green is director of Global Learning and Development for Steelcase Inc., a company whose brands offer a comprehensive portfolio of workplace furnishings, products and services, inspired by nearly 100 years of insight gained serving the world’s leading organizations. Through her many leadership positions within Learning & Development, Manufacturing Operations, Human Resources, Marketing Communications and Order Services, Faye has had a unique opportunity to influence the growth of Steelcase’s diverse and high-performance work culture. Faye speaks and consults with organizations on organizational culture, workforce performance, diversity and related topics. She has also influenced the strategic direction of organizations in a variety of roles from co-creator and co-chair to trainer and facilitator. |
||
| Gather. Analyze. Communicate. Action. |  LeAnn DeHoff Senior Insights Lead, Citrix Education Citrix Systems |
|
| You gathered students’ feedback. Now what? LeAnn will speak on the topic of aligning measurement with business strategy in a customer education training model. She will present a case study on how to analyze students’ feedback, present vital findings to organization leaders, and convert findings into actions.
Bio: LeAnn DeHoff leads Citrix Education’s Insights team and provides customer, market, and business analysis which is used to enhance Citrix Education’s business strategy. In her role, LeAnn actively integrates Metrics That Matter data into intelligence reports, communicating students’ past experiences and providing recommendations to help improve students’ future experiences with Citrix Education products. LeAnn has 10+ years experience with consumer and market research, a BS in Behavioral Science, and a MS in Psychology, with a Specialization in Industrial-Organizational Psychology. |
||
| 11:00a – Noon Keynote |
Beyond HR – A Business Approach to Building Human Capital |  John W. Boudreau, Ph. D. University of Southern California’s Marshall School of Business and Center for Effective Organizations |
| John will discuss how HR practitioners can best present the outcomes of human capital using metrics that business partners understand.
Bio: Dr. Boudreau is recognized for breakthrough research on how decisions about human capital, talent and human resources affect sustainable competitive advantage. He has published more than 50 books, articles, and chapters. |
||
| 1:15p – 2:30p Panel |
Addressing ROI The Right Way – Once and For All!!!
No presentation available |
Kent Barnett KnowledgeAdvisors Facilitator |
| Frank Anderson, Josh Bersin, John Boudreau, Jack Phillips
Bios: Mr. Anderson is a retired Brigadier General, United States Air Force. Mr. Anderson and the DAU organization have won many awards including Best Corporate University. Mr. Anderson supports the Under Secretary, Acquisition, Technology and Logistics in executing department-wide Defense acquisition workforce strategic planning, policy and program responsibilities. Josh Bersin has worked with hundreds of companies to deliver high-impact employee learning, leadership development, and talent management. In 2001, he founded Bersin & Associates to provide research and advisory services focused on corporate learning. Today, the firm is the “go to” source for learning and HR decision makers seeking product and market data, insight on trends and expert advice on enterprise learning and talent management. Bersin is a frequent speaker at global industry events, is a columnist for Chief Learning Officer magazine, and has been quoted in The Wall Street Journal, BBC Radio’s In Business and on National Public Radio’s Morning Edition. Bersin is also the author of The Training Measurement Book: Best Practices, Proven Methodologies, and Practical Approaches (April 2008, Pfeiffer) and The Blended Learning Book: Best Practices, Proven Methodologies, and Lessons Learned (October 2004, Wylie/Pfeiffer). Dr. Boudreau is recognized for breakthrough research on how decisions about human capital, talent and human resources affect sustainable competitive advantage. He has published more than 50 books, articles, and chapters. As a world-renowned expert on measurement and evaluation, Jack J. Phillips is chairman of the ROI Institute. Through the Institute, Phillips provides consulting services for Fortune 500 companies and major global organizations. The author or editor of more than 50 books, he has conducted workshops and presented at conferences in 44 countries. |
||
| 2:45p – 3:45p Breakouts |
Measurement Programs and Competency Management | Kendall Kerekes Vice President, Human Capital KnowledgeAdvisors |
| KnowledgeAdvisors will discuss how organizations can use technology and expertise to optimize talent measurement programs, including 360/multi-rater events.
Bio: Kendall brings over 10 years of Human Resources Executive experience to KnowledgeAdvisors, along with her project management, strategic planning, leadership development, training evaluation, personnel selection/validation, performance assessment/improvement, and change management experience. Having held senior HR positions at Ameriquest and Indymac Bank, her individual practitioner, business project manager, team leader, and Human Resources executive experience brings a real world perspective to measurement methodologies. Kendall earned an MS in Industrial/Organizational Psychology from California State University of San Bernardino. |
||
| The Measurement Journey at Hill Air Force Base |  Ken Woodard Chief, Education and Training Instruction Branch Center Training Division, Ogden Air Logistics Center, Hill Air Force Base UT |
|
| This session will present a case study on the business case, implementation process and day-to-day measurement approach for Hill Air Force Base measurement of L&D.
Bio: Kenneth Woodard is chief of the Education and Training Instruction Branch at Ogden Air Logistics Center, Hill Air Force Base UT. Responsible for education and training in support of 10,500 civilian employees who perform life-cycle management of aircraft and weapons systems from initial fielding and continuing through decades of field operations. The diversity of training Ken is charged to execute ranges from science and engineering, worldwide supply and logistics management and execution of technically complex depot overhaul of air force aircraft, missiles and commodities. Ken’s experience includes 30 years maintaining and flying aircraft, which includes 20 years on active duty and the last 10 years in the learning and development arena. |
||
| Best Practices in Measuring Manager Engagement |  Robert O. Brinkerhoff Professor Emeritus Western Michigan University |
|
| Robert will share years of experience in how to get the right learner into training and how to measure the success of solid manager engagement.
Bio: Brinkerhoff is creator of the innovative Success Case Method for evaluation of training, author of numerous books on evaluation and training, and has been a keynote speaker and presenter at hundreds of conferences and institutes worldwide. |
||
| Cisco’s Measurement Journey, Past, Present and Beyond |  Randy Pearson Cisco, Learning & Development Solutions Group Cisco Systems |
|
| This session will present a case study on the learning measurement journey at Cisco starting with education and strategy through implementation, integration and decision-making.
Bio: Randy has an engineering background and has held senior management positions in Operations at Cisco for many years – including Operations Manager for Cisco’s Engineering Training organization. In conjunction with the consolidation of all training groups at Cisco, Randy has recently been appointed as Strategy & Metrics Manager. In this role, Randy is working to architect the underlying strategies for the new, Cisco-wide learning organization and the measurement platforms required to ensure the organization’s goals are achieved. |
||
Day 3 Agenda
| SYMPOSIUM Day #3 Friday, March 5, 2010 – 7:30am – 12:15pm Sessions are subject to change |
||
| Time | Activity/Description | Presenter |
| 7:30a – 8:30a Sunrise |
KnowledgeAdvisors Product and Solutions Update |  Jeb Metric VP of Product KnowledgeAdvisors Kendall Kerekes VP of Human Capital KnowledgeAdvisors |
| KnowledgeAdvisors will provide an update on the most recent and upcoming product releases and an overview on creative consulting solutions.
Bio: Jeb brings over 10 years of experience in custom software development, architecture, data warehousing, and application development to KnowledgeAdvisors and is responsible for all facets of Metrics that Matter® application architecture, development, and infrastructure. Jeb earned a BA from the University of Chicago and is currently studying Chinese. Kendall brings over 10 years of Human Resources Executive experience to KnowledgeAdvisors, along with her project management, strategic planning, leadership development, training evaluation, personnel selection/validation, performance assessment/improvement, and change management experience. Having held senior HR positions at Ameriquest and Indymac Bank, her individual practitioner, business project manager, team leader, and Human Resources executive experience brings a real world perspective to measurement methodologies. Kendall earned an MS in Industrial/Organizational Psychology from California State University of San Bernardino. |
||
 ESI International and KnowledgeAdvisors partnership
Presentation not available |
 Raed Haddad Senior Vice President, Global Delivery Services ESI International |
|
| ESI International and Knowledge Advisors will discuss their new partnership and strategic plans for 2010 that will include the benefits of measurement in demonstrating ROI for training investments.
Bio: Raed Haddad is responsible for ensuring ESI exceeds client expectations in the delivery of all its services and products worldwide. Raed works directly with clients to develop strategies that drive competitive advantage through delivery and measurement of ESI-driven performance improvement programs. ESI clients benefit from Raed’s more than 25 years of multi-cultural, project management expertise across a range of industries, including: health care, technology, government, telecom and financial services. |
||
| 8:30a – 9:30a Keynote |
Optimizing the Performance of People at Qualcomm |  Tamar Elkeles, Ph. D. Vice President of Learning and Organizational Development Qualcomm |
| Dr. Elkeles will provide an overview of the Qualcomm Learning Center and the solutions it provides. This session will include a discussion on strategies to align learning and development with the business and how the Learning Center uses Metrics that Matter to maintain alignment and optimize quality and impact of its solutions.
Bio: As Vice President of QUALCOMM’s Learning Center, Tamar Elkeles, Ph.D., is responsible for defining the overall learning and development strategic direction for the company. Her scope of leadership includes global learning, executive/leadership development, technical development, employee communications, organization development and learning technology for more than 15,000 QUALCOMM employees worldwide. |
||
| 9:45a – 10:45a Breakouts |
Best Practices in Optimizing Your Measurement Technology Solution |  Jeff Grisenthwaite Senior Director, Operations KnowledgeAdvisors |
| KnowledgeAdvisors will present an overview of the Metrics that Matter optimization model to assess current measurement maturity and identify improvements.
Bio: Jeff oversees service and support to Metrics that Matter® customers, helping clients to optimize use of the technology and improve the impact of their workforce. Before coming to KnowledgeAdvisors, he led the development of eLearning, courseware, and customer training programs for DDC Training Services. Jeff earned a BA in English from Kalamazoo College. |
||
| Benchmarks as Business Intelligence |  Jac Fitz-enz, Ph.D. Founder and CEO Human Capital Source |
|
| This session will provide an overview of benchmarking concepts and explain how to optimally use reasonable benchmarks to interpret data and apply it to predictive analysis for timely decision-making, points of reference and business intelligence.
Bio: Dr. Jac introduced metrics to human resources in 1978 and over three decades developed the methodology through benchmarking and descriptive analytics. Now, he is training organizations on predictive analytics. This management system covers planning, process optimization and performance measurement enabling HR professionals to take on tomorrow’s challenges today. Through the integration of human capital with financial data they learn how to shift people from the expense column to the revenue generating side. In the end HR becomes an accepted business partner. |
||
| Performance Support: Why it Matters and How to Measure It |  Bob Mosher Global Chief Learning and Strategy Evangelist LearningGuide Solutions USA |
|
| This session will provide an overview of an informal learning method that can have significant impact and can have measurable results.
Bio: Bob has been an active and influential leader in the learning and training industry for over 25 years and is renowned worldwide for his pioneering role in e-learning and new approaches to learning. Bob has received two lifetime achievement awards in the IT Training industry. In 1997, Bob received the ITTA’s Eddy Award for Excellence, awarded to individuals who exemplify excellence in the IT education industry. And most recently he received the Institute for IT Training’s 2006 Colin Conder award. |
||
| 11:00a – Noon Keynote |
Using Governmentwide Employee Surveys to Produce Meaningful Organizational Change |  Joseph Hillery Manager, Survey Analysis U.S. Office of Personnel Management |
| This session will highlight the background and process of the comprehensive OPM Federal Employee Viewpoint survey to make decisions within Federal Government agencies to bring about meaningful organizational change.
Bio: Joe Hillery is responsible for the administration of governmentwide surveys at OPM including the Federal Human Capital Survey. He is past president of the Personnel Testing Council of Metropolitan Washington and is currently teaching in the MBA program at the University of Maryland University College. Joe received his Ph.D. in Industrial/Organizational Psychology from the University of Akron. |
||
