Kano Survey, Usecase Validation & Competitor Assessment

IBM ENVIZI - SCOPE 3 USER DISCOVERY

The below study represents my own POV, and does not represent or indicate IBM's current or future product and business direction.

Participant details, key takeaways, revenue/metrics, and other confidential information have been redacted below for public preview.

"As supply chain teams face growing ESG regulatory pressures, which users will be working together to take the burden of new responsibilities?"
"Of the proposed customer usecases, can we validate which to develop first based on market relevancy, user painpoints and customer ESG maturity?"
"How would prioritized features compare in the competitive landscape, particuarly with recent advances in the packaging & communication of similar technologies?"
INITIAL RESEARCH QUESTIONS
"...this has provided a level of competitive intel that would otherwise not have been able to be uncovered by the project management team...has helped in the development of our PLG strategy."
PRODUCT DIRECTOR, IBM ENVIZI
"josh is incredibly dedicated to his team players. He played a key role in enabling me to contribute value to the team within my first 2 months..."
LEAD USER RESEARCHER, SCIS

[Role]

project lead // researcher

[research team]

scis ux design lead
scis sr. uxr
scis lead uxr

[proj. time]

6-8 weeks

[PRODUCT]

IBM ENVIZI ESG SUITE
ibm supply chain intelligence suite

[PUBLISHED]

2023

[WORK REQ. BY]

DIR. OF PRODUCT MGMT
sr. scis product management

[audience]

ENVIZI PM TEAM
scis global pm team
scis design team
ibm design research org

[FEATURED]

Q2 QUARTERLY DESIGN REVIEW
Q3 UXR TOWN HALL

[METHODS]

stakeholder workshops
kano feature value survey
ANALYST + SECONDARY LITERATURE
EXTERNAL SME RECRUITMENT
MODERATED INTERVIEWS
kano quantitative analysis
PUBLIC COMPETITOR SCRAPING
COMPETITOR UX ANALYSIS

[DELIVERABLES]

keynote & global playback
hands-on annotated mural
as-is & to-be user experience journeys
usecase validation scoring
design + product enhancements
pm education deep dive
uxr education material + sessions
kano analysis automation tooling

STUDY overview:

With a newly acquired team and a host of new technologies at bear, there was a challenge to integrate & deliver on competitive Scope 3 capabilities that were validated & targeted to appropriate customer users. Growing regulatory requirements meant customers were facing more pressure than ever to account for the emissions in their supply chain; and time was of the essence.

I led the multi-timezone research team in addressing this challenge, creating and coordinating the multi-phase research plan to ensure continuous delivery against production timelines, while maintaining research depth & rigour.

This first phase of work was intended to calibrate our Scope 3 Category 1 solution strategy; validating internal hypotheses around user journeys, feature requirements, and buyer vs user priorities.

Deloitte: Scope 1-3 Emissions Intro US EPA: Scope 3 Categories 1-15Folding Burrito: The Complete Guide to Kano

approach:

  • Worked with IBM Sustainability Software leadership to map knowledge gaps & product needs from disparate stakeholder groups in disjointed timezones
  • Developed a comprehensive research plan, enabling round-the-clock coverage by allocating multiple researchers to the project.
  • Rapid recruitment of external SMEs for quickfire discovery interviews; insights used allowed for initial validation and design kickoff
  • Facilitated collaboration workshops with product management teams to generate and prioritize feature proposals using the Kano quantitative survey method
  • Employed a mix of qualitative and quantitative methods, distributing feature surveys and sketches to expert SMEs at scale, supplemented by in-depth user interviews for nuanced insights.
  • Interpreted quantitative data and spliced results across demographics for comparison
  • Competitor UIs scraped across sources into IBM-comparable structure for annotation & analysis, cross-referenced with Kano results & analyst literature
  • Insights across multiple domains/sources synthesized into key takeaways playback; updates on personas, buyer behavior, competitor advancements,
"one of the problems we have is capability...our procurement people are procurement people, and esg needs them to go learn other things and that can be quite difficult."
director, commercial procurement
"WE SUGGEST [REDACTED] TO OUR CLIENTS, TO AUTOMATE THE PROCESS...WE SAY IT TAKES 7 DAYS TO GENERATE A REPORT BECAUSE IT TAKES YOUR PEOPLE 4 DAYS TO ENTER THE DATA."
DATA SCIENTIST, SUPPLY CHAIN CONSULTING

impact & outcomes:

  • Recommendations blended quantitative results with qualitative context, then aligned with production timelines to garner working credibility & buy-in quickly with new & existing product management teams
  • Kano prioritization results, validated users & usecases identified directly fed the creation of internal vision team's user story, with targeted personas & painpoints having prominent influence on POC/MVP development
  • Developed user stories & capabilities featured as part of IBM enablement materials & sales landing pages
  • Tooling that was created to reduce overhead for Kano quantitative processing templatized and shared; led in-person/virtual interactive Kano education sessions as well as contributing to IBM UXR curriculum
  • New international researchers successfully onboarded to both IBM UXR process & culture while executing on valuable research in parallel
  • Research process & insights highlighted on internal IBM Q2 Quarterly Design Review & Q3 UXR Global Town Hall
  • Research insights from this work is continuing to pay off in current efforts, and additional impact updates will be added as work releases.
Competitor experiences broken down and selectively compared H2H against IBM's own; supplemented with matching participant quotes to highlight value of feature capabilities.
This study saw excellent positive feedback & longevity, with even participants enjoying the study; research process used has been turned into enablement material & hands-on educational sessions.