I’m going to have to help you out here Hugo.
Although it has several possible origins, “three-by-two”, “four-by-two” or “five-by-two” indeed refers to a Jew in Cockney rhyming slang, which is a way of coining slang words that originated among working-class, mid-19th-century Londoners and is still largely associated with London speech.