Gently shake off any excess flour. 4. Heat oil over medium-high heat and fry the coated cauliflower pieces for about 3-4 minutes, turning occasionally, until they turn golden brown and crispy.