Skip navigation

Dr Hubert P. H. Shum

Associate Professor (Reader), Director of Research and Innovation

Department: Computer and Information Sciences

Hubert P.H Shum is Associate Professor (Reader) and Director of Research and Innovation at Northumbria University

Hubert ShumI am an Associate Professor (Reader) in Computer Science at Northumbria University, as well as the Director of Research and Innovation of the Computer and Information Sciences Department. I lead the Computational Intelligence and Visual Computing Research Team, which consists of 9 faculty members, 2 post-doctoral researchers and 22 PhDs. Before this, I worked as a Senior Lecturer at Northumbria University, a Lecturer at the University of Worcester, a postdoctoral researcher at RIKEN Japan, and a research assistant at the City University of Hong Kong. I received my PhD degree from the School of Informatics at the University of Edinburgh, as well as my Master and Bachelor degrees from the City University of Hong Kong.

As for the research funding to support my team, I am the PI of a £124,000 EPSRC grant on human motion analysis, and a £11,800 Royal Society grant on smart environments. I have also been the funding management officer of a €3.03 million Erasmus Mundus project. In addition to these, I have received more than £300,000 from Northumbria University to hire PhD students and purchase research equipment.

I have organized conferences such as the British Machine Vision Conference, ACM SIGGRAPH Conference on Motion in Games and the ACM Symposium on Virtual Reality Software and Technology. I have served as a member of Program Committee more than 30 times in 9 conferences, including the Pacific Conference on Computer Graphics and Applications (PG), and the ACM/Eurographics Symposium on Computer Animation (SCA). I am an Associate Editor of Computer Animation and Virtual Worlds, and have been a Guest Editor of Computers and Graphics. I have collaborated with industrial partners especially from the healthcare sector, such as NHS Newcastle Gateshead CCG, NHS Innovation North, Kinesio UK and Your Homes Newcastle (City Council). I have established an international academic network with institutes such as Waseda University, INRIA, the University of Edinburgh and the University of East Anglia.

Further Information

Web Page

YouTube Channel

Google Scholar

Campus Address

Pandon Building
Northumbria University
Newcastle upon Tyne
NE1 8ST

0191 243 7607

Qualifications

BEng (Hons), MSc, PhD, Fellow of the Higher Education Academy

Research Themes and Scholarly Interests

My research is built around the problem of human motion understanding, which is to model human motion in a meaningful way, such that one can generalize knowledge to synthesize, analyze and recognize movement.

Human motion understanding has an overlapping area in computer graphics, in which I research on areas such as character animation, crowd simulations and visualization. It also overlaps with computer vision in areas including action recognition, activity recognition, smart environments. Finally, it overlaps with human-computer interactions, in areas like motion capturing, motion-based applications and virtual/augmented reality.

Sponsors and Collaborators

I am particularly interested in applying my research in the healthcare and security industry. I work with the NHS and the City Council to adapt some of my research to create a smart monitoring system that understands human behaviour and provides support. I work in the industry such as Faurecia, one of the largest French car parts manufacturing company, and Kinesio, an international sports product company, in areas such as ergonomics and motion analysis. I connect with Lenovo, the largest personal computer manufacturer, to work on smart electronics.

I am well connected to world class institutes in the world. In the UK, I work closely with the University of Edinburgh and the University of East Anglia. In Japan, I collaborate with the University of Tokyo and Waseda University Japan, which are the best public and private universities in Japan respectively. In France, I work with INRIA, one of the largest government-funded research institute, and University Rennes 2. In Hong Kong, I work with the City University of Hong Kong and the Hong Kong Baptist University, which are both top-ranked universities in the world.

Key Publications

Jingtian Zhang, Hubert P. H. Shum, Jungong Han and Ling Shao, "Action Recognition from Arbitrary Views Using Transferable Dictionary Learning," IEEE Transactions on Image Processing, IEEE, 2018.

Lining Zhang, Hubert P. H. Shum and Ling Shao, "Manifold Regularized Experimental Design for Active Learning," IEEE Transactions on Image Processing, vol. 26, no. 2, pp. 969-981, IEEE, Feb 2017.

Zhiguang Liu, Liuyang Zhou, Howard Leung and Hubert P. H. Shum, "Kinect Posture Reconstruction based on a Local Mixture of Gaussian Process Models," IEEE Transactions on Visualization and Computer Graphics, vol. 22, no. 11, pp. 2437-2450, IEEE, Nov 2016.

Lining Zhang, Hubert P. H. Shum and Ling Shao, "Discriminative Semantic Subspace Analysis for Relevance Feedback," IEEE Transactions on Image Processing, vol. 25, no. 3, pp. 1275-1287, IEEE, Mar 2016.

Joseph Henry, Hubert P. H. Shum and Taku Komura, "Interactive Formation Control in Complex Environments," IEEE Transactions on Visualization and Computer Graphics, vol. 20, no. 2, pp. 211-222, IEEE, Feb 2014.

Hubert P. H. Shum, Edmond S. L. Ho, Yang Jiang and Shu Takagi, "Real-Time Posture Reconstruction for Microsoft Kinect," IEEE Transactions on Cybernetics, vol. 43, no. 5, pp. 1357-1369, IEEE, 2013.

Hubert P. H. Shum, Taku Komura and Shuntaro Yamazaki, "Simulating Multiple Character Interactions with Collaborative and Adversarial Goals," IEEE Transactions on Visualization and Computer Graphics, vol. 18, no. 5, pp. 741-752, IEEE, May 2012.

Hubert P. H. Shum, Taku Komura, Masashi Shiraishi and Shuntaro Yamazaki, "Interaction Patches for Multi-Character Animation," ACM Trans. Graph., vol. 27, no. 5, pp. 114:1-114:8, ACM, Dec 2008.

 

To view my Northumbria Research Link page click here

Professional Activity

I am interested in high-quality conference organization. I am the Program Chair of the ACM SIGGRAPH Conference on Motion in Games 2016 and the Local Chair of the ACM Symposium on Virtual Reality Software and Technology 2014. I am proposing the host, in Northumbria University, the British Machine Vision Conference 2018 and the ACM SIGGRAPH Conference on Motion in Games 2018. I have served as a member of Program Committee in many international conferences, such as the Pacific Conference on Computer Graphics and Applications, ACM/Eurographics Symposium on Computer Animation, British Machine Vision Conference, International Conference on Computer Animation and Social Agents, ACM Symposium on Virtual Reality Software and Technology.

I am also interested in technology transfer. I worked with the industry in various technology transfer project. I own a patent on Manufacturing Video Graphics (Publication Number: WO/2010/057897).

I and my research team has obtained a number of awards such as the Best Paper Award in the 2016 UK Workshop on Computational Intelligence, the Best Poster Award at the 2016 ACM SIGGRAPH Conference on Motion in Games, the IEEE CIS Outstanding Student-Paper Travel Grants, and the Best Paper Award at the 2008 Annual Conference on Computer Animation and Social Agents.

Postgraduate Supervision

  • Daniel Organisciak, PhD, Northumbria University, Research topic: Machine Learning for Computer Vision
  • Shanfeng Hu, PhD, Northumbria University, Research topic: Recognizing and Understanding User Behaviours in Smart Homes
  •  Kaveen Perera, PhD, Northumbira University, Research topic: Video Summarization with Deep Learning
  • Jingtian Zhang, PhD, Northumbria University, Research topic: Action Classification using Transfer Learning with Synthesized Training Data
  • Kevin Mccay, PhD (Co-Supervised), Northumbria University, Research topic: Human Motion Analysis
  • Zheming Zuo, PhD (Co-Supervised), Northumbria University, Research topic: Artificial intelligence for Smart Home Systems
  • Yao Tan, PhD (Co-Supervised), Northumbria University, Research topic: Rule Base Generation for Fuzzy Rule Interpolation
  • Yijun Shen, PhD (Graduated), Northumbria University, Research topic: Motion Synthesis using Captured Human Motion Data
  • Naoya Iwamoto, PhD (Co-Supervised, Graduated), Waseda University, Research topic: Character Deformation Simulation with Position-based Dynamics.
  • Pierre Plantard, PhD (Co-Supervised, Graduated), Rennes 2 University, Research topic: Posture Reconstruction for Ergonomics Applications
  • Zhiguang Liu, PhD (Co-Supervised, Graduated), City University of Hong Kong, Research topic: Kinect-based Posture Reconstruction using Gaussian Models
  • Liuyang Zhou, PhD (Co-Supervised, Graduated), City University of Hong Kong, Research topic: Human Motion Variation Synthesis
  • Wakana Asahina, MSc (Co-Supervised, Graduated), Waseda University, Research topic: Automatic Dance Generation with Sign Language
  • Xi Chen, MSc (Co-Supervised, Graduated), Newcastle University, Research topic: Dimensions Estimation with Depth Images Provided by Kinect

Current/Recent Projects

External Funding

  • Creative Fuse North East: £24,000, Co-Investigator (PI: Shoes2Run Limited, Industrial Partner), 2018, Project title: Shoes2Run Wearable Technology
  • Royal Society International Exchanges (Ref: IE160609): £11,841, Principal Investigator, 2017-2018, Project title: An Affective Smart Environment for Personalized Learning and Teaching
  • Graduate Program for Embodiment Informatics (Ref: H29-LDGSN-024 & H29-LDGSN-025): ¥2.93 million (~£20,000), Contributing Researcher, 2017-2018
  • Erasmus Mundus Action 2 Programme (Ref: 2014-0861/001-001): €3.03 million, Funding Management Officer, 2015-2018, Value to Northumbria University: €440,000, Project title: Sustainable Green Economies through Learning, Innovation, Networking and Knowledge Exchange (gLink)
  • EPSRC First Grant (Ref: EP/M002632/1): £124,000, Principal Investigator, 2014-2017, Project title: Interaction-based Human Motion Analysis (see project details from EPSRC)
  • MEXT Top Global University Project Scholarship: £5,500, Contributing Researcher, 2015-2016

 

Internal Funding

  • Capital Expenditure for Research Equipment (Ref: 511988, 511276, 511671, 510536, 512820): £134,000, Principal Investigator, Northumbria University, 2013-2018
  • Research and Enterprise Reward Scheme (Ref: 510972): £9,700, Principal Investigator, Northumbria University, 2015-2017
  • Top-up Fund for EPSRC Project: £24,300, Principal Investigator, Northumbria University, 2015-2017
  • Postgraduate Research Scholarship: £65,000 x 2 = £130,000, Principal Investigator, Northumbria University, 2015-2017
  • New Academic Staff Support Grant (Ref: 100700-IO114845): £2,000, Principal Investigator, Northumbria University, 2012-2013
  • Vacation Research Assistantship: £1,000, Principal Investigator, the University of Worcester, 2012
  • Initiating Knowledge Transfer Fund (Ref: 7P-2414): £15,000, Contributing Researcher, the University of Edinburgh, 2009-2010


+

Northumbria Open Days

Open Days are a great way for you to get a feel of the University, the city of Newcastle upon Tyne and the course(s) you are interested in.

Research at Northumbria
+

Research at Northumbria

Research is the life blood of a University and at Northumbria University we pride ourselves on research that makes a difference; research that has application and affects people's lives.

+

Order your prospectus

If you would like to know more about our courses, or life in general as a student at Northumbria, then we can help you.

Latest News and Features

More news

Back to top