Editor's Synopsis
MIT Sloan professor Rama Ramakrishnan outlines a three-step framework for identifying the right generative AI use cases in business. The approach begins with breaking jobs into discrete tasks, since not all tasks within a role are equally suited for LLM automation — preparing course materials can be partially automated, while moderating discussions cannot. Next, organizations should apply a generative AI cost equation that accounts not just for licensing fees but also the less obvious costs of achieving the required accuracy, building error-detection mechanisms, and managing reputational risk. If the total cost of AI automation is lower than the status quo, the third step is to build, launch, and rigorously evaluate pilots, choosing from vendor solutions, commercial models like GPT-4, or open-source options like Llama 3.
Ramakrishnan also offers several best practices for successful implementation: maintain a robust error-checking process with a human in the loop, consider narrow and targeted use cases that require smaller and cheaper models, cultivate AI talent outside traditional data science teams, and prioritize low-stakes, high-volume use cases for quick ROI and organizational learning. He emphasizes that tasks failing the cost equation today should be revisited periodically, as rapidly improving LLM capabilities are steadily driving down adoption costs. The overarching advice is to avoid paralysis by starting with easy wins and scaling from there.
