Yes. Affiliate managers can be allowed to add users to one affiliate while they can be restricted to add affiliates to other affiliates.
This setting can be managed by the Admin.
The affiliate manager will be able to add users to particular affiliates only if the setting "Add / Disable affiliate users" affiliates setting is enabled.
In case, the affiliate manager is assigned to 3 affiliates but the setting "Add / Disable affiliate users" is enabled only for one affiliate, then the affiliate manager will be able to add / disable users only for that particular affiliate.
The option for setting "Add/Disable affiliate users" is seen on the affiliate creation/overview page.