9 Results

9.1 Results Menu        
      9.1.1 Queue 
      9.1.2 Execution 
      9.1.3 Results 
9.2 Reviewing Execution Results
 
      9.2.1 Execution Summary 
      9.2.2 Run Summary 
      9.2.3 Reset Summary 
      9.2.4 Schedule and Schedule Summary 
      9.2.5 Schedule Reports 

 

9.1 Results Menu

The Results Menu provides the ability to view the Executions queued to run, the current Execution underway and the table of results which summarizes completed Executions. It is through the results table that completed Executions can be opened and schedules reviewed.

9.1.1 Queue

Executions set to run are listed in the Queue. Once an Execution reaches the top of the Queue list it will be the next to run. Executions that have been set to pause in the Queue are also listed but will need to be manually enabled to run from the Queue list. Likewise, Executions listed in the Queue can be removed as desired.

To open and review the Queue,

  1. Click on the Results menu located on the main task bar.
  2. Select Queue from the drop-down list.

    image542

  3. The Queue window will open listing the Executions in the Queue list.

    image543

  1. To pause an Execution listed in the Queue so that it will not automatically run click the Pause checkbox next to the desired Execution.

    image544

    An Execution can also be set to pause in the Queue when initiating the Execution (see Section 8.1)

 

9.1.2 Execution

An immediate summary of the status and current results of an Execution underway can be reviewed live in the Execution window. It is in this window that the progress of an Execution can be monitored and where the current best solutions are reported.

To monitor an Execution in progress,  

  1. Click on the Results menu located on the main task bar.
  2. Select Execution from the drop-down list.

    image542 2

  3. The Execution window will open. The current Execution underway will be visible with the Current Run and its status summarized along with a table of Top Schedules summarizing the best result from the current Run.

    image545

    Peak NPV is the maximum cumulative NPV achieved at any point over the course of a schedule. The Peak NPV is not necessarily the schedules overall NPV.

  1. To pause the Execution click the Pause button.

    image546

  1. To resume the Execution click the Play button.

    image547

  2. To cancel the Execution underway click the Stop button.

    image547 2

    When an Execution is canceled, the incomplete results will still appear in the Results table and be available for review.

  1. When the Execution is complete the summary for the completed Execution will close. If another Execution is queued, it will begin and automatically open its Execution summary.

    image548

 

9.1.3 Results

The Results window reports the summarized results of all finished Executions, both completed and cancelled in table format.  Executions can be quickly re-executed from the Results table. Detailed Execution results can also be opened from the table. Parameters to report in the Results table can be selected or removed by the user and include:

 
The aggregated metrics reported in the Results table such as average NPV and standard deviation are calculated using all schedules generated in the Execution, not just the top schedules that have been saved.

To open and examine the Execution Results table,

  1. Click on the Results menu located on the main task bar.
  2. Select Results from the drop-down list.

    image542 3

  3. The Results window will open. A table listing all finished Execution in this SOT project will be visible, this includes both cancelled and completed Executions (including failed).

    image549

  1. To select the statistics and parameters to report in the Results table right click the table column labels and select from the dropdown list the parameters to report.

    image550

  2. To run another Execution using the same configuration as one listed in the Results table, right-click the Execution and select Rerun from the list of options.

    image551

  3. To re-name an Execution listed in the Results table, right-click the desired Execution and select Rename from the list of options.

    image551 2

  4. To copy the Results table, right-click the table and select Copy table from the list of options.

    image551 3

  5. To delete an Execution listed in the Results table, right-click the desired Execution and select Delete from the list of options.

    image551 4

  6. To open the Results of an Execution double-click on the desired Execution.

    image552 2

  7. The schedule result will open in another window.

    image552

 

9.2 Reviewing Execution Results

The Execution Results window is where Execution statistics, Run statistics and saved schedules are reported and can be examined in detail. Schedule Reports detailing the equipment, length capacities, weight capacities, attribute capacities and financial results for a saved schedules are also created and reviewed in the Execution Results.

9.2.1 Execution Summary

All the settings that were used to generate the Execution’s Runs, Resets and schedules are reported in the Execution Summary. The Execution Summary also reports the statistics of a finished Execution which includes the following:

 

To review the Execution Summary reports,

  1. With the Execution Result window open, double click on the Execution Result in the side panel.

    image553

  1. The Execution Summary window will open with the Stats tab already visible.

    image554

  2. To review all the settings used in the Execution click on the Parameters tab.

    image554 2

  3. The Parameters tab will open. Select a setting category to review for the Execution from the View dropdown list.

    image555

  4. The selected setting summary will open, reporting the setting configuration details used in the Execution.

    image556

  1. When Mine Scenario is selected however a list of all Mine Scenario settings will open. Expand the desired setting category by clicking the arrow next to the listed category.

    image557

  2. To review a specific Mine Scenario setting, double click on the desired setting listed under the expanded category.

    image558

  1. The setting will open reporting the configuration used for the Execution.

    image559

 

9.2.2 Run Summary

All Runs completed within an Execution will be listed with their results available for review. In the Run Summary both the Run statistics and Learning Trace for each Run are reported. The statistics reported for the schedules generated in the Run include the following:

 

A Learning Trace is the average and maximum NPV, of the population of schedules, plotted for each iteration in a Run. Learning Traces are used to assess how much improvement was made to the value of a population of schedules over all the iterations that were conducted. Learning Traces can be helpful in assessing if further Executions may provide improvements to the top schedules that have been generated.

To review the Run Summary reports,

  1. With the Execution Result window open, expand the list of Runs by clicking the arrow next to the Execution Summary in the side panel.

    image560

  2. The list of Run Summaries will be expanded in the side panel, open the desired Run Summary by double clicking on it.

    image561

  1. The Run Summary window will open with the Stats tab already visible.

    image562

  1. To review the Run’s Leaning Trace open the Learning tab by clicking on it.

    image562 2

  2. A plot of the Runs Learning Trace and a table reporting the average and maximum NPV results of each iteration in the Run will open.

    image563

  1. To copy the iteration table, right click the table and select the Copy Table option.

    image564

 

9.2.3 Reset Summary

All saved Resets within a Run will be listed, each with their results available for review. Reset Summaries report a finished Reset’s statistics which includes the following:

 

The Dependency Map used to generate schedules in the Reset is also contained in the Reset Summary and available for review. The Dependency Map reports all dependencies imported when the SOT v3 project was created and all the dependencies created in SOT from Added Dependency settings.

To review the Reset Summary reports,

  1. With the Execution Result window open, expand the list of Resets in the Run by clicking the arrow next to the desired Run Summary in the side panel.

    image565

  2. A list of the saved Resets will open in the side panel, double click on the desired Reset to open its Reset Summary.

    image566

    Recall that not all Resets generated are saved, only the quantity of top Resets specified in the Execution’s Run Settings are saved.

  1. The Reset Summary window will open with the Stats tab already visible.

    image566 2

  2. To review the Dependency Map for the Reset click on the Dependency Map tab.

    image566 3

  1. The Dependency Map tab will open to a table listing each task with a dependency and the tasks corresponding predecessor task.

    image567

 

9.2.4 Schedule and Schedule Summary

All saved schedules generated within a Reset will be listed and accessible under the Reset label in the side panel list. Completed schedules are reported by activity with corresponding Start and Finish dates, in table format. In the schedule table the text and production fields of each activity are also reported. From an open schedule, a schedule Seed can be created, the schedule exported (to .exf or .csv) and Schedule Reports generated. A schedule summary is also reported and includes the following values:

 

An Equipment Usage report is also accessible and available for export (to .csv) from an open schedule. The Equipment Usage report details the activity each instances of equipment is assigned to and when that assignment begins. Likewise, when each instance of equipment is idle is also reported.

 

Schedule Tab

The Schedule tab is where the generated schedule can be reviewed in table format, a schedule Seed created, the schedule exported (as an .exf or .csv) and Schedule Reports generated. The Schedule tab is also where the schedule result summary is reported.

To open and review a schedule,

  1. With the Execution Result window open, expand the list of schedules in the Reset by clicking the arrow next to the Reset of interest located in the side panel.

    image568

  1. A list of the saved schedules will open in the side panel. Open the schedule of interest by double clicking on it.

    image569

    Recall that not all schedules generated are saved, only the quantity of top schedules specified in the Execution’s Run Settings are saved.

  1. The Schedule window will open with the Schedule tab already visible. Here the schedule is reported in the sortable table containing the ‘Activity ID’, ‘Task Name’ ‘Objective’ classification and the start and finish times along with all production and text fields contained in the SOT project.

    image570

To create a Seed for the schedule under review,

  1. With the Schedule tab open for the schedule of interest click on the Create Seed button.

    image571

  2. A Generate seed dialog box will open. Name the Seed and click OK.

    image572

  3. The Seed will be created and saved within the SOT v3 project. To review the newly created Seed open the Seeds window (refer to Section 6.3.2)

To generate an .exf file of the schedule under review,

  1. With the Schedule tab open for the schedule of interest click on the Export (.exf) button.

    image571 2

  2. An Export to EXF dialog window will open. Name the .exf file and select a location to save the file to; click OK.

    image573

  3. The schedule will now be exported as an .exf to the location specified.

To export the schedule, as reported in the table, as a .csv file,

  1. With the Schedule tab open for the schedule under review click on the Export (.csv) button.

    image571 3

  2. An Export to CSV dialog will open. Name the .csv file and select a location to save the file to; click OK.

    image574

  3. The schedule will now be exported as a .csv file to the specified location.

To generate a Schedule Report for the schedule under review,

  1. With the Schedule tab open for the schedule of interest click on the Request Reports button.

    image571 4

  2. A Report Request Parameters dialog window will open. First select a date to begin the report on from the date selector.

    image575

    The Report Start does not necessarily have to coincide with the schedule start date.

  1. Select the time period (days, weeks and years) over which to report the schedule’s capacities and financials.

    image576

  2. Define the number of time periods to create the schedule report for by either leaving the To end of mine life option checked or de-selecting the check box and entering an integer value. Click OK.

    image577

 

Equipment Usage Tab

The Equipment Usage tab is where the schedule’s equipment allocation and usage is reported. It is also where an allocation and usage report can be exported to .csv.

To review the schedule’s Equipment allocation,

  1. Click on the Equipment Usage tab for the opened schedule.

    image571 5

  1. The Equipment Usage window will open; select the equipment of interest from the Equipment pane on the left by clicking on it.

    image578
  1. The Usage table will be populated with all the activities that required the Equipment along with their corresponding time and instance number. The time when each instance of equipment is idle is also reported in the table.

    image579

  2. To filter the Usage table to review only one instance of equipment uncheck the other equipment instances in the Instances pane.

    image579 2

  3. To export the Usage table as displayed click the Export (.csv) button.

    image579 3

  4. An Export to CSV dialog window will open. Name the .csv file and select a location to save the file to. Click OK.

    image580

  1. The .csv will now be exported and saved to the location specified.

 

9.2.5 Schedule Reports

Schedule Reports are created for completed schedules and generate multiple report fields for each production field or text field utilized in the Execution. Schedule Reports are intended to aide users in quickly calculating and reviewing field quantities (production or text), scheduled over specific time intervals, throughout the mine life.

When project settings such as equipment assignments, Activity Filters, Constraint Conditions and Constraint Triggers are applied, often the production (or text) field quantities that are effectively used in a schedule differ from the production (or text) field values imported when the project was created. Due to the likely difference between an imported production field (or text) and the same field’s effective usage, production (or text) fields each have three different report fields generated and displayed to the user.

The first report field details the overall production field quantities scheduled to occur, where the quantities are those that were imported when the project was created. The second report field details the effective production field quantities scheduled to occur, of that same production field. The third report field details the portion of the production field quantities that are subject to a Capacity Constraints associated with the field.

Report Field Name Description
[production field or equipment name] Production field as imported when the SOT project was created.

No Activity Filter or equipment assignments are taken into account when this field is calculated.
[production field or equipment name] (Actuals) The production field quantities scheduled and used according to the project configuration of Activity Filters and equipment assignments.

Capacity Constraint Conditions will not result in any production field quantities being excluded from what is reported here.
[capacity constraint name] (Actuals) The portion of the production field subject to the Capacity Constraint. Activity Filters, equipment assignments, and Capacity Constraint Conditions are all taken into account to calculate these quantities.

The production field quantities not subject to a Capacity Constraint Condition will not be reported here as they are not subject to the condition.

 

The time interval which production field usage is set over is user defined and can be defined in units of days, weeks or years. The occurrence of particular text fields, production fields and Capacity Constraints are presented both in graph and table format. Schedule Reports can be exported to .csv file in table format.

To generate a Schedule Report for a schedule,

  1. With the Schedule tab open for the schedule of interest click on the Request Reports button.

    image571 6

  2. A Report Request Parameters dialog window will open. First select a date to begin the report on from the date selector.

    image575

    The Report Start does not necessarily have to coincide with the schedule start date.

  1. Select the time period (days, weeks and years) over which to report the schedule’s capacities and financials.

    image576

  2. Define the number of time periods to create the schedule report for by either leaving the To end of mine life option checked or de-selecting the check box and entering an integer value. Click OK.

    image577

To open the Schedule Report generated,

  1. With the Execution Result window open, expand the list of Schedule Reports located in the side panel by clicking the arrow next to the schedule of interest.

    image581

    image582

  2. Click the arrow next to Report Requests.

    image583

  3. A list of all the Schedule Reports generated for the schedule will open in the side panel. Open the Schedule Report of interest by double clicking on it.

    image584

  4. The Schedule Report window will open with the Schedule Report tab already visible.

    image585

 

Schedule Report Tab

The Schedule Report tab is where the completed Schedule Report generated according to user defined time intervals will be visible in table format. It is also from this tab that the entire Schedule Report can be exported to .csv. One schedule can have numerous Schedule Reports generated for it and usually it is best to generate one Schedule Report for each time interval unit.

When reviewing Capacity Constraints using Schedule Report plots ensure that the time interval the Capacity Constraint was enforced over matches the time interval the Schedule Report was generated over. If the time intervals do not match when reviewing Schedule Report plots, it may appear that Capacity Constraints are being violated when they are actually not.

To export the Schedule Report,

  1. With the Schedule Report tab open for the schedule of interest click the Export (.csv).

    image586

  2. An Export to CSV dialog window will open. Name the .csv file and select a location to save the file to. Click OK.

    image587

  3. The Schedule Report will now be exported and saved to the location specified.

 

Financial Tab

The Financial tab in a Schedule Report presents the various financial parameters for the schedule under review, plotted over time. The financial parameters available to plot in a Schedule Report include:

 

To review a Schedule Report’s financial plots,

  1. With the Schedule Report open, click the Financial tab.

    image588

  2. The Financial tab will open to a blank plot. Plot a financial parameter for the Schedule Report under review by clicking the check box next to a listed financial parameter located on the right.

    image589

  3. The parameter will be plotted instantly. Additional financial parameters can be plotted on the same graph by clicking on additional check boxes.

    image590

 

Production Tab

The Production tab presents a portion of the schedule’s generated report fields plotted over time. One of the plotted report fields details the entire production field or text field count, as it was imported into SOT when the project was created, over time. The second report field details the effective production field or text field count quantity that actually occurred in the schedule as a result of activity filters and project settings. For report fields to be generated and visible in the Production tab for a production field or text field count, the field must have been used to define a setting used in the Execution. The production field or text field count does not need to have been used in a Capacity Constraint. Length, weight and count type report fields are reviewable in this tab. Likewise, for comparison purposes there is the ability to plot multiple report fields simultaneously.

Recall that the report field graph which displays the entire contents of the field as it was imported, is labeled either ‘[production field name]’ or ‘[equipment name]’. The plot displaying the effective field quantity that actually occurred based on the projects Activity Filters and equipment assignments is labeled ‘[production field] (Actuals)’ or ‘[equipment name] (Actuals)’.


To review a Schedule Report’s production field plots,

  1. With the Schedule Report open, click the Production tab.

    image591

  2. The Production tab will open to a blank plot. Plot a length type production field for the Schedule Report under review by clicking the checkbox next to a listed production field of interest.

    image592

  1. The production field selected will plot instantly. Additional length type production fields can be plotted on the same graph by selecting other fields as desired. 

    image593

  1. To plot a weight type production field for the Schedule Report under review select Mass from the Field Type from dropdown list.

    image594

  2. A new list of production fields (weight type) will be listed in the right pane. Plot a weight type production field by clicking on a listed field’s checkbox.

    image595

  1. The weight type production field will plot instantly. Additional weight type production fields can be plotted on the same graph by clicking on additional checkboxes.

    image596

  1. To plot the count of any text field or SOT defined equipment for the Schedule Report under review select Count from the Field Type dropdown list.

    image597

  2. A new list of text field attribute and/or equipment will be listed in the right-hand pane. Plot an equipment or attribute count by clicking on the checkbox of an equipment definition or attribute listed in the right pane.

    image598

  3. The attribute or equipment will be plotted instantly. Additional attribute or equipment counts can be plotted on the same graph by clicking other checkboxes.

    image599

 

Capacity Tab

The Capacity tab presents the report fields relating to Capacity Constraints utilized in the Execution. The portion of the production (or text) fields that are subject to a Capacity Constraint are plotted over time, for each Capacity Constraint defined. Length, weight and count type report fields are all reviewable in this tab. Capacity Constraints must have been defined to be visible and a selectable option to plot in this tab.

To review Capacity Constraint plots,

  1. With the Schedule Report open click the Capacity Tab.

    image600

  2. The Capacity tab will open to a blank plot. Plot a length type Capacity Constraint for the Schedule Report under review by clicking the checkbox next to a listed Capacity Constraint of interest.

    image601

  3. The length type Capacity Constraint field will plot instantly. Additional length type production fields can be plotted on the same graph by clicking on additional checkboxes.

    image602

  1. To plot a weight type production field for the Schedule Report under review select Mass from the Field Type from dropdown list.

    image603

  2. A new list of Capacity Constraints (weight type) will be listed in the right pane. Plot a weight type Capacity Constraint by clicking on a listed constraint’s checkbox.

    image604

  3. The weight type Capacity Constraints will plot instantly. Additional weight type Capacity Constraints can be plotted on the same graph by clicking on additional checkboxes.

    image605

  1. To plot the count of any Capacity Constraint for the Schedule Report under review select Count from the Field Type dropdown list.

    image606

  2. All of the schedules Capacity Constraints will be listed in the right-hand pane. Plot the count that occurred for the Capacity Constraint by clicking on the checkboxes listed in the right pane.

    image607

  3. The Capacity Constraint will be plotted instantly. Additional constraint counts can be plotted on the same graph by selecting additional checkboxes.

    image608

 

 

Back to Top