Drain the olives to remove the brine they come in and give them a quick rinse.
Grab a dish that is large enough to fit the olives in a single layer. Toss all of the ingredients together in the dish, cover and refrigerate for a minimum of 4 hours, preferably overnight.
Remove from the refrigerator 30 minutes before serving so that the oil can liquefy again.