Indeed it is quite strange I find to have both operation and form display, but you do not especially need to have a form operation to use your display. You have to use hook_entity_type_alter
though...
Here is the way for example to load the "super" form mode (if exists and is activated) :
/**
* Implements hook_entity_form_display_alter().
*/
function my_module_entity_form_display_alter(&$form_display, $context) {
// Load the right entity form display.
$id = $context['entity_type'] . '.' . $context['bundle'] . '.super';
$storage = \Drupal::entityManager()->getStorage('entity_form_display');
$change_display = $storage->load($id);
// If form mode is activated, replace the given one with ours.
if ($change_display) {
$form_display = $change_display;
}
}