story identification - Title of a fantasy novel about ape like humanoids that are invaded by humans

I just remember that the "Hairy" ape like creatures that can use magic get invaded my humans. Supplies run low for the humans so they start to eat the ape like creatures is the one part I distinctively remember.