The process in which a relatively unspecialized cell acquires specialized features of a tongue muscle cell. [ http://www.ncbi.nlm.nih.gov/pubmed/3393851 GOC:yaf http://purl.obolibrary.org/obo/CL_0002673 ]