Citizen science program uses artificial intelligence to track thousands of humpback whales

The flukes of a humpback whale still visible as it dives below the surface
“Old Timer” may be the oldest known humpback, first sighted Lynn Canal, Southeast Alaska 1972. Also sighted as PWF-NP1117 and HIHWNMS-2017-2-25WWG01A01 (Photo by Jim Nahmens, courtesy of Happy Whale)

It’s a special moment, watching a gigantic humpback going for a deep dive. The whale’s back arches and the tail swings up, disappearing below the surface like the pointed toes of an Olympic diver.

The black-and-white patterns on the underside of a whale’s tail fins, or flukes, are unique. Now a citizen science program called Happy Whale uses artificial intelligence to quickly identify humpbacks from those patterns.

Through photographs shared by whale watchers, Happy Whale has recorded thousands of whales that travel to and from Alaska.

“Like facial recognition, we can tell who it is,” said Ted Cheeseman, an expedition scientist who has studied whales all over the world, including in Antarctica. He co-founded Happy Whale as a way to track humpbacks, a species that’s known to travel thousands of miles.

It’s helping to answer a lot of questions about their individual behavior.

“Who does the whale hang out with? Does the whale have a calf?” Cheeseman said. “What is the larger story here such that we can build family relationships and so on, tell more of the story of the individual. To me, that’s a huge part of this.”

The difference between this photo ID program and others in the past is the manpower needed. Happy Whale uses an automated computer program to ID the photos instead of people doing it by hand. Just one full-time and two part-time employees run the database and confirm the results.

The program started in 2015 but took years to test and fine tune. Now, whale watchers can share their fluke photos and locations to the online database, which has identified 68,000 humpbacks worldwide.

The program started with 18,000 whale photos that had been previously identified by hand. Cheeseman says Happy Whale is more efficient.

“Somebody gives me a dataset of a thousand photos, it used to be that that would be an hour per photo,” Cheeseman said. “The actual matching time is now insignificant. If someone gives me a thousand photos I can tell them the next day that, ‘Oh, 700 of them are these known whales and these 300, those are probably new.'”

The program has documented about 30,000 humpbacks in the North Pacific, which Cheeseman expects is about 70% of the population.

Participants are rewarded for their work. They usually get an initial response within a few days to a week and get notices when their whale is spotted again.

Dennis Rogers, a long-time whale watching guide in Petersburg, has uploaded over 5,500 photos to the program.

“It’s very interesting just to see the migrations,” Rogers said. “Some of these whales go to Hawaii for the winter, and they’re re-sighted there, which we get a notification when that re-sighting happens. Some of our whales go to Mexico. It’s real interesting, some of our whales go to Mexico one year and to Hawaii the next year.”

Rogers encourages his clients to send in their photos as well. He says other tracking systems, including satellite tags, can fall off whales within days.

“This is purely un-invasive and gives a great amount of information over time. Some of our whales, we’ve been tracking close to 40 years,” Rogers said.

The program has found some unusual migrations in Alaska’s individual whales, said Scott Roberge, a board member for Petersburg’s Marine Mammal Center.

“They’ve followed one from Alaska to Hawaii to Japan back to Alaska,” Roberge said. “Made the loop of the North Pacific.”

Roberge also contributes photographs and enjoys getting the feedback.

“It’s incredible to get that information and to get the email that says, ‘Oh, the whale that you took a picture of last summer was just found in Hawaii, and it just had a baby,” he said.

Cheeseman believes that over 95% of humpbacks in Southeast Alaska are in the database already. But the program is expanding. Cheeseman hopes to automate dorsal fin recognition within the year, which would allow them to identify and track orcas and other species a lot faster.

Cheeseman gave a presentation in Petersburg on May 18 at the Wright Auditorium.

KFSK - Petersburg

KFSK is our partner station in Petersburg. KTOO collaborates with partners across the state to cover important news and to share stories with our audiences.

Sign up for The Signal

Top Alaska stories delivered to your inbox every week

Read next

Site notifications
Update notification options
Subscribe to notifications