yes, it is NOT the most convenient, query you could imagine.

UPDATE `table_name` SET `column_name` = REPLACE(`column_name`, 'replace_this', 'with_this')
WHERE `column_name` LIKE '%with_this%' COLLATE utf8mb4_bin;

it is what phpmyadmin generates when you go here:

admin