Can we assign specific consultants to a specific widget/site?

Yes you can, it can be done via Widget >> Teams

Step 1 : Go to Widgets

Step 2 : Under Widgets, Click on “Teams” and assign a widget to a specific team :)