In a frying pan, combine the olive oil, olives, orange zest, lemon zest, garlic, and red pepper flakes. Place the pan over medium heat and cook, stirring, until the garlic is sizzling and fragrant, around 3 minutes. Add the orange segments, orange juice and lemon juice and cook, gently stirring, until the orange segments are warmed through, around 1 minute. Remove the pan from the heat, add the parsley and basil and stir through to combine. Taste the salsa for seasoning and adjust with salt and lemon juice as desired. Set aside until ready to serve.