Rethinking Human Factors Through Human Rights in AI Strategy

Human Factors is often described through the lenses of safety, usability, and human-centred design. While these are important aspects of our profession, I believe they point to something more fundamental.

At its core, Human Factors exists to protect and advance human interests. As AI becomes increasingly embedded in our lives, that perspective matters more than ever.

Unlike many in our profession, my interest in AI did not begin with autonomous vehicles, intelligent automation, or the promise of AI-assisted healthcare. While these developments were exciting, what captured my attention was something broader: AI’s ability to shape the
social fabric through which we experience the world.

Today, algorithms influence much of what we see, read, discuss, and believe. They help determine which news reaches us, which content appears in our social media feeds, and which opportunities are presented to us online. Over time, the people we meet, the information we consume, and the conversations we have are increasingly mediated by
systems designed to predict and influence human behaviour.

The stories we tell about search engines presenting different results to different users, or social media platforms serving content most likely to keep us engaged, are now commonplace. Yet these examples point to something significant. Algorithms do not merely organise information; they shape human experiences and, ultimately, human outcomes.

Human Factors and Human Rights

The more I have worked in automation and AI, the more I have come to believe that many of the challenges we face are not fundamentally technical problems. They are human ones, and this is where Human Factors has an important role to play.

Consider some of the concerns that Human Factors professionals have traditionally focused on:

  • Out-of-the-loop effects that can undermine safety
  • Reduced engagement and skill degradation resulting from underload
  • Changes to worker roles, responsibilities, and identity
  • Ethical concerns surrounding the collection and use of personal data

At first glance, these may appear to be separate issues. Look closer, however, and a common theme emerges.

Out-of-the-loop effects are ultimately concerns about human safety and the protection of life. Data ethics is fundamentally concerned with privacy. Changes to worker roles and automation-driven displacement raise questions about meaningful work, dignity, and economic participation (United Nations, 1948).

Photo by KATRIN BOLOVTSOVA on Pexels.com

These are not simply design challenges. They are questions about how technology affects people and society.

Arguably, there is nothing more aligned with the mission of Human Factors than protecting the interests of the people who live and work within the systems we help create. Whether we explicitly frame these concerns as human rights, human wellbeing, or human interests, the underlying objective remains the same: ensuring that technological progress serves people rather than the other way around.

A Broader Role for Human Factors

We often describe ourselves more narrowly than this.

Much of the language used to explain Human Factors focuses on operational performance, usability, or the well-established lessons of automation. These remain important, but they can also obscure the broader contribution our discipline is capable of making.

At the same time, computer scientists are increasingly tackling questions of human-AI collaboration. Policymakers are grappling with the societal implications of AI. Legal and regulatory experts are attempting to understand and mitigate potential harms. These conversations are all, in one way or another, concerned with the relationship between people and technology.

Human Factors has both expertise and responsibility in this space. The discipline is often criticised for being too broad. I would argue the opposite.

We are narrow in purpose and broad in expertise.

That distinction matters: what looks like breadth is actually coherence across contexts where human experience intersects with technology.

Our purpose is simple: to ensure that systems serve human needs and human interests.

The methods we use to achieve that purpose may vary. We draw from psychology, engineering, design, systems thinking, ergonomics, organisational science, and many other disciplines. Yet the objective remains remarkably consistent. We seek to understand how technology affects people and how systems can be designed to support human capability, wellbeing, autonomy, and safety.

Viewed through that lens, Human Factors is not a supporting discipline that becomes relevant once technology has already been developed. It is a strategic discipline that should help shape decisions from the outset.

Shaping the Future of AI

This is why I believe Human Factors is at its most valuable when it informs governance, policy, and organisational strategy—not simply design and evaluation.

The most important questions surrounding AI are increasingly questions about people. How should decisions be allocated between humans and machines? What level of oversight is appropriate? How should personal data be collected and used? What responsibilities do organisations have to workers whose roles are transformed by automation? What kinds of futures are we actively choosing to create?

These questions cannot be answered by technical expertise alone.

Too often, Human Factors is perceived as a discipline that slows innovation down by identifying risks and constraints. A more constructive framing is that Human Factors helps direct innovation towards outcomes that are genuinely beneficial for people.

Photo by ThisIsEngineering on Pexels.com

We are not simply concerned with whether a system works. We are concerned with who it works for, who it disadvantages, and what kind of future it helps create.

Viewed this way, many of the challenges surrounding AI begin to look surprisingly familiar. Questions of safety, privacy, autonomy, dignity, and meaningful work have always sat at the heart of Human Factors practice. We may use different language, but we have been grappling with these issues for decades.

Perhaps there is nothing more fundamentally Human Factors than protecting human rights.

The right to life and safety. The right to privacy. The right to meaningful work and participation in society. As AI becomes increasingly capable and increasingly embedded within our institutions, these rights will not protect themselves. They will require deliberate design choices, thoughtful governance, and professionals willing to advocate for human interests.

That is why Human Factors belongs at the AI strategy table.For those interested in exploring this perspective further, I highly recommend Human Rights, Robot Wrongs by Susie Alegre. The book offers a compelling examination of how emerging technologies intersect with human rights and why these questions should concern all of us—not just lawyers, policymakers, or technologists.

Alegre, S. (2024). Human Rights, Robot Wrongs: Being Human in the Age of AI. Atlantic Books.

Additional References

United Nations General Assembly. (1948). Universal Declaration of Human Rights. https://www.un.org/en/about-us/universal-declaration-of-human-rights

European Union (2000/2009) Charter of Fundamental Rights of the European Union. Consolidated version, 2012/C 326/02. Available at: https://eur-lex.europa.eu/eli/treaty/charter_2012/oj

Can interpersonal (human-to-human) communication inform the future of autonomous vehicles?

Imagine that you wake up and get ready for work. You exit your home and begin your commute in an autonomous vehicle. You are greeted by a virtual assistant, who asks you how you are feeling today, and where you’d like to travel. During this journey, both you and the autonomous vehicle are expected to be a team, and each of you may control the vehicle at different stages of the journey. Ultimately, you are both partially responsible for the vehicle’s safe operation – depending on who is in control and who holds liability (a tricky topic, and one best left for another blog post!).

What does this virtual assistant look like? How does it communicate? How emotionally connected are we to this technology? In an emergency how does the assistant handle the situation to keep you and others safe? Many of these questions are yet been answered, and the research community is divided over whether or not we can apply how humans naturally communicate with one another to answer these questions.

Developing an automation assistant for semi-autonomous vehicles (research article and book coming soon!)

Key works such as ‘The Media Equation’ by Reeves and Nass (1996) suggest that we treat machines as social agents, and that we often exhibit feelings and behaviours analogous to those in our inter-personal relationships such as empathy, frustration, and politeness. There are others that argue that how we treat humans is fundamentally different to how we treat machines, both from a reduction of harm perspective (i.e., we are less protective of harming a machine than another human; Bartneck et al., 2005). Those on this side of the debate state that communication between humans cannot be readily replicated by technology. In the centre, many influential works began investigating interpersonal communication and were then repurposed for human-computer interaction as the benefits of this work were realised as technology developed (e.g., Clark, 1996; Klein et al., 2004; 2005).

We are fundamentally limited to current or past technology to guide our conversations. But what does this debate mean for the future of AI and autonomous technology? As virtual assistants become smarter, more efficient, and perhaps more aware, the proposition that inter-personal communication can be beneficial for the human-robot interaction community may become more prevalent – if not only to understand how we can improve etiquette, effective communication of information, and promote natural communication.

During my doctoral research, I investigated how humans communicate with one another when handing over safety-critical tasks in areas such as healthcare, aviation, and control-rooms (Clark et al., 2019a). I wanted to understand how professionals, such as ambulance staff handing over a patient to an intensive-care unit used language, what strategies they preferred, and ultimately, what information they thought was critical to operational safety. I replicated a handful of strategies in an autonomous vehicle simulation and found that the lessons I had learnt from human-human communication, specifically in healthcare, were beneficial not only to human-computer interaction, but to an entirely different domain-of-study (Clark et al., 2019b). The source material of human-communication had provided me with communication strategies that has now taken the form of an in-vehicle automation assistant.

Replicating human-human communication in an ‘autonomous’ vehicle
(Clark et al., 2019b)

My new book: Human-Automation Interaction Design: Developing a Vehicle Automation Assistant, is expected to be published later this year. You’ll find the details of my journey from human-communication to an in-vehicle interface and all the steps in between including literature reviews, user-workshops, experiments.

Keep an eye on my work, and I look forward to bringing you more content soon!

References

Bartneck, C., Rosalia, C., Menges, R., & Deckers, I. (2005). Robot Abuse – A Limitation of the Media Equation. Rome, Italy: Interact 2005 Workshop on Abuse.

Clark, H. H. (1996). Using language. Cambridge: Cambridge University Press.

Clark, J. R., Stanton, N. A., & Revell, K. M. A. (2019a). Conditionally and highly automated vehicle handover: A study exploring vocal communication between two drivers. Transportation Research Part F: Psychology and Behaviour, 65, 699-715.

Clark, J. R., Stanton, N. A., & Revell, K. M. (2019b). Identified handover tools and techniques in high-risk domains: using distributed situation awareness theory to inform current practices. Safety Science, 118, 915-924.

Klein, G., Feltovich, P. J., Bradshaw, J. M., & Woods, D. D. (2005). Common ground and coordination in joint activity. Organizational Simulation, 53, 139-184.

Klein, G., Woods, D. D., Bradshaw, J. M., Hoffman, R. R., & Feltovich, P. J. (2004). Ten challenges for making automation a “team player” in joint human-agent activity. IEEE Intelligent Systems, 19(6), 91-95.

Reeves, B., & Nass, C. (1996). The media equation: How people treat computers, television, and new media like real people. Cambridge, UK: Cambridge University Press.