Microsoft PowerPoint - KC AUTM metrics Cleveland.ppt

METRICS FOR KNOWLEDGE TRANSFER
Past, Present & Future
Dr Kevin Cullen
Director
Research & Enterprise
The University of Glasgow

Today I will…..
• Tell you about the TT/KT Measurement
model we developed in the UK
• Tell you about the metrics we developed
• Tell you what we are doing now and
where we are going with metrics.

To Measure effectively, we must know
the objectives of Knowledge Transfer!
Well, the University exists to:
• Create knowledge
• Disseminate knowledge

Knowledge Dissemination
•
Publication to peers
•
Teaching to students
•
Knowledge Transfer – to industry/society/economy
sooooo…Knowledge transfer is the 3rd Dissemination channel

And….
Technology/Knowledge Transfer fits
University mission
• Need to understand drivers
• Define success

In our Model:
Disseminate
Create
Disseminate
For
For
Knowledge
Public
Profit
Good
Research

Outreach
Research
Outcome
SME support/
Collab/
Licensing
Student
Contract
Spin-outs
support
Research

A coherent spectrum of objectives, activities and beneficiaries
Outreach
Research
Outcome
Objectives
Public Good
Create Knowledge
Profit
Investors,
Partners
EDA’s, Government
Research Funders
entrepreneurs
Financial returns
None
Cover costs
Can be significant
Students, Small Co’s,
Beneficiaries
Knowledge Base
University
Society, Economy

Financial Profile Across the Spectrum
Return to University
£/$
Outreach
Research
Outcome

NOTE however – we should also recognise relative importance
£/$ revenues
Outreach /
Collab.
Contract
Licensing
Venturing
Economic Dev
Research
Research
Spin-Outs

To measure the performance reasonably, need to capture
• Volume of Activity
• Quality
• Impact

Outreach
Outcome
Research &
Outreach Activities
Technology Dev.,
Contract Research
Licensing
Venturing
No. of:
No. of:
No. of:
No. of:
• SMEs worked with
• Research Awards
• Disclosures
• Business Plans
Activity
• Student placements
• Consultancy
• Patent Applications
• Joint Ventures
• Companies created
• CPD
• Patents Granted
• Companies
• Networking events
• Proof of Concept
• Options Granted
leveraging in external
investments
Income in support of
Income:
Income from
Value of equity
Quality
activities and
• Research (HESA)
licensing, cash or
realisation
• Consultancy
equity value upon
feedback
• Etc.
realisation
Longitudinal and
No. of jobs created in
Export income, no. of
No of jobs created,
Impact
difficult to track
HEIs
jobs created in HEIs
turnover and
realisation of equity

In Scotland We Adopted the Income Approach
•
Income is the best proxy we have for quality
- 3rd party objectivity
•
Income also shows volume => quantity
•
Data available in most cases
•
Data auditable
•
Enabled ‘weighting’ by Funding Council across the spectrum

Status
• System has been operating well
• Funding Council Happy
- can show massive activity
- demonstrating massive leverage
• TTO Directors and many senior research
officers agree no changes to metrics
would make sense at this time
• There is still a need to develop the next
generation of measures/metrics

International Metrics Project
•
Joint UNICO/AUTM/ACCT project
•
Developing impact measures
•
Funded by SFC/HEFCE/RCUK/OSI (GU Grantholder)
•
Seeking to determine impact measures required by:
- University Management
- Research Funders
- Policy-makers
- Customers

Objectives
• Identify overall picture of metric
requirements
• Identify what already exists (and from
whom)
• Identify gaps (and responsibilities)
• Collate existing and collect new data
• Benchmark internationally
….it is not easy, it is a complex system!

Elements & Players in TT & KT Ecosystems
• How big is the KT agenda?
• What is expected?
• Who has responsibility?
…major topic in the UK since 1995

• The University is a key actor in the
innovation ecosystem.
BUT
• The University is only part of the system.

The University is only part of the system
University
Research
Innovation
System

The University is only part of the system
University
University
Teaching
Research
Innovation
System

The University is only part of the system
University
University
Teaching
Research
University TT
Innovation
System

The University is only part of the system
University
University
Teaching
Research
University TT
Service
Providers
Innovation
System

The University is only part of the system
University
University
Teaching
Research
University TT
Service
Providers
Innovation
System
Capital
Providers

The University is only part of the system
University
University
Teaching
Research
University TT
Service
Providers
Innovation
System
Capital
Providers
RDAs
Local
‘Culture’

The University is only part of the system
University
University
Teaching
Research
University TT
Service
Providers
Innovation
Government
System
Policy
Capital
Providers
Company
Innovation
RDAs
Entrepreneurial
Local
Activity
‘Culture’

The University is only part of a system
University
University
Teaching
Research
University TT
Research
Funding
Service
Providers
Innovation
Government
System
Policy
Capital
Providers
Company
Innovation
RDAs
Entrepreneurial
Local
Activity
‘Culture’

The role of the University
•The University is a part of the ecosystem, but ONLY a part.
•We need partners and other stakeholders to take responsibility for the other parts
•We will take responsibility for what the University can contribute.
•University Research has been cited as key…
….we need to be clear on what University research contributes

The Contribution of University research
New
Knowledge
Research
Researchers

Publications
Processes
New
Knowledge
Materials
Technology
Research
Know-how
Innovation
Researchers
Skills

Teaching
Networking/
Publications
Events
Processes
Consultancy
New
Knowledge
Materials
CPD
Technology
Collaborative
Research
Research
Know-how
Contract
Research
Innovation
Researchers
Licensing
Skills
Company
Creation

Teaching
Networking/
Publications
Events
Processes
Consultancy
New
Knowledge
Materials
CPD
Knowledge
Technology
Collaborative
Research
Research
£
Know-how
$
Contract
Research
Innovation
Researchers
Licensing
Skills
Company
Creation

Teaching
Networking/
Publications
Events
Start-up
Processes
Consultancy
New
Spin-out
Knowledge
Materials
CPD
Knowledge
Society
Technology
Govt
Collaborative
Research
Research
£
Policy-
makers
Know-how
$
Contract
Research
Small Co’s
Innovation
Researchers
Licensing
Big Co’s
Skills
Company
Creation

ALL SORTS OF
OTHER FACTORS
Teaching
Networking/
Publications
Events
Start-up
Processes
Consultancy
New
Spin-out
Knowledge
Materials
CPD
Knowledge
Society
Technology
Govt
Collaborative
Research
Research
£
Policy-
makers
Know-how
$
Contract
Research
Small Co’s
Innovation
Researchers
Licensing
Big Co’s
Skills
Company
Creation
ALL SORTS OF
OTHER FACTORS

ALL SORTS OF
OTHER FACTORS
Teaching
Networking/
Publications
Events
Start-up
Processes
Consultancy
New
Spin-out
• Jobs
Knowledge
• New Products
Materials
CPD
Knowledge
Society
• New services
• Turnover
Technology
Govt
Collaborative
• Profit
Research
Research
£
Policy-
makers
• R&D expenditure
Know-how
$
• % turnover from
Contract
Research
Small Co’s
new products/
services
Innovation
Researchers
Licensing
Big Co’s
Skills
Company
Creation
ALL SORTS OF
OTHER FACTORS

I’m starting to think that…..
•
We should concentrate on outputs (rather than
impacts).
•
We can demonstrate the volume and quality of what we
do and that should be our focus.
•
Since we are only a contributor to the final impact, we
can’t take all the credit or all of the blame.
•
We must continue to develop the ways in which we
measure what we do…
•
It’s more than measuring licensing income, but it’s less
than measuring economic impact.

Thank you for listening
[email address]