You have to add a relationship to the term being referenced on the content type. Then you'll have access to all of fields available on the terms under your field selection section of the view's configuration form.
EDIT:
Since It seems that because in your view you are trying to reference terms from a node that is being referenced from the node that's being displayed, even with grouping and aggregation, it would be difficult to try to create what you want directly in the view. It may be a better option, in your case, to use a view template for the field with the terms.
So it would look something like this (views-view-field--view-display-name--field-machine-name.tpl.php):
<?php
// Example code to grab the current field output value
$doc = new DOMDocument();
$doc->loadHTML($output);
$raw_val = $doc->getElementsByTagName("div")->item(0)->nodeValue;
// Now load the term programmatically to get the price value
foreach ($row->field_*field_machine_name*[0]['raw']['tid'] as $tid) {
$term = taxonomy_term_load($tid);
$price = $term->field_price['und'][0]['value'];
}
?>
<?php // print $output; ?>
<!--Now reconstruct the output-->
<div class="whatever-wrapper">
<span class="whatever-name"><?php print $raw_val; ?></span>
<span class="whatever-price"><?php print $price; ?></span>
</div>
Now you may not need to go through the whole process of loading the term, I just showed that as an example. This data may already be available to you in the other variables in the scope of that file which are;
* Variables available:
* - $view: The view object
* - $field: The field handler object that can process the input
* - $row: The raw SQL result that can be used
* - $output: The processed output that will normally be used.
Play around with something like that (the file should probably live in your theme's templates directory), and use the Devel module so that you have access to the dpm() function, which will print whatever you put in there on the page in an organized way. I recommend using dpm() on the $view, $field, and $row variables so you can see what you have available to you before trying to load the term programmatically in the template.
You can visit this Drupal docs page for more info on theming single fields in a view.