The rise of generalists in the AI era
Kuala Lumpur—Since the emergence of ChatGPT, many have been concerned about its potential negative impacts. Debates have sprung up, and tools have been developed to detect if assignments were crafted with the help of ChatGPT. This concern is understandable. For instance, even in a notoriously difficult statistical machine learning course I taught last semester, ChatGPT could easily tackle it. I tested it with my final exam questions, and it outperformed nearly 90 percent of my students. However, I don’t think we should prohibit students from using such tools.
Is artificial intelligence (AI)-generated content plagiarism? That is to be debated. But to start, implementing such a ban is almost impossible due to the nature of machine learning. Machine learning is fundamentally different from our typical internet searches. It efficiently extracts inherent relationships in data. When AI generates content, it randomly samples based on these relationships rather than retrieving the most matching content. Therefore, the output can’t strictly be called “plagiarism” as it doesn’t specifically “copy” from any particular dataset, just like an impromptu speech might revolve around the same ideas but will never be identical each time.
Should we be worried that students will stop learning? While these tools will definitely revolutionize our teaching methods, I see it as a positive change. Just like I became reliant on Google Maps, it allows me to invest my time and energy into honing other skills.
Undoubtedly, traditional rote-learning methods are most at risk, especially when faced with advanced language models. While the future of educational approaches remains uncertain, I’m convinced that the new methods will prioritize problem-solving skills over rote memorization. Typical assignments, like multiple-choice questions, are too easy for these large language models (LLMs). I prefer assigning research-based projects, which reflect students’ genuine capabilities.
While current large-scale language models do have reasoning abilities, they still somewhat lack lateral thinking. If students can guide AI models based on their learning, the quality of the solutions achieved with AI assistance will significantly improve. In this era, learning how to harness AI tools effectively is essential for everyone.
While machine learning is all the rage, and computer science enrollments are skyrocketing, I’m often asked about major selection advice. Being at the intersection of astrophysics and computer science, I have some thoughts to share.
For those genuinely passionate about computing, a computer science degree is great. But, understand that the curriculum encompasses much more than just machine learning, including traditional system designs and compilers. As the use of LLMs becomes commonplace, interdisciplinary knowledge is crucial. For instance, without knowledge in astrophysics, utilizing these models to extract valuable insights from LLMs becomes challenging.
Interestingly, many leaders in the machine learning community don’t come from a computer science background. For instance, some researchers at Anthropic, a main competitor to OpenAI, hail from physics backgrounds. Experts from varied academic fields bring unique perspectives and often introduce innovative viewpoints.
We are in an era where generalists are emerging as leaders. Only by understanding and integrating specific application scenarios can the true value of these tools be fully realized. And I believe this is the greatest gift machine learning offers.
Looking back at the Industrial Revolution, individuals were often seen as mere cogs in the vast machinery of society, repetitively performing the same tasks. This “cog-in-the-machine” approach meant anyone could easily be replaced, ensuring continuous societal functioning. However, this often led to dehumanization.
Now, as machine learning capabilities show, repetitive tasks are likely the first to be automated, whether they are low-level or high-end specialized tasks. Although jobs will undergo major transformations, and there are genuine concerns, those who will excel in this tech-driven era will be the generalists who thrive in multiple domains, rather than isolated specialists.
In this era of rapid change and competition, the accessibility of machine learning (as I’ve mentioned in previous writings) has made global competition unprecedentedly open. It’s no longer just about the race between superpowers (unlike the nuclear arms race). Only nations that nurture a vast number of interdisciplinary experts will stand out. Asia News Network
—————-
Dr. Yuan-Sen Ting serves as associate professor at the Australian National University, where he contributes to both the astronomy and computer science departments. He also holds an associate professorship in astronomy at The Ohio State University. His research primarily centers on employing machine learning to enhance statistical methods, especially when working with extensive astronomical datasets.
—————-
The Philippine Daily Inquirer is a member of the Asia News Network, an alliance of 22 media titles in the region.
