P&C 102: Rater Governance
Bryan O'Neal
Updated on Feb 13, 2025
Hello, I'm Brian O'Neill from Coherent. Today, I'll demonstrate how an Excel model, specifically a cyber insurance rater, can be transformed into an API. This API is accessible at a specific endpoint where you can input data and receive outputs in response. The key question is: how do you govern this model?
Governing the model involves making changes, versioning, debugging, testing, and promoting it from a lower to a higher environment. Essentially, you need to treat Excel as source code. Let's dive into the process.
Access the Coherent UI and locate the version overview section. Here, you can see the current version, for example, version 0.1.
Open the Excel model and make necessary changes. For instance, adjust the California base rate.
Save the changes and drag and drop the updated spreadsheet onto the existing service. Add a note, such as "bump up California base rate."
The system compiles this version separately, creating a semantic minor version (e.g., 0.2), allowing multiple rate sets in production without deprecating the old version.
This process empowers business users to make changes independently without involving the tech team.
If a supervisor wants to review changes between versions, they can use the "compare versions" feature. Coherent generates a visual diff highlighting:
New additions in green
Deletions in red
Changes in bright yellow
Downstream impacts in lighter gold
This provides a clear audit trail of the model's evolution.
Every API call is logged, showing details like calculation time and total time. Users can review inputs and outputs for each call and even rehydrate the Excel model with specific call data, aiding in audit and compliance.
Versions are iterated in a lower environment, with options for dev, UAT, and prod environments. Only thoroughly tested versions are promoted, integrating with your CICD pipeline.
Create a test bed, a collection of test cases. For this demo, we'll use 1,500 random test cases.
Randomly select inputs like state, gross revenue, hazard group, and liability limit, defined in Excel data validation rules.
Run the test bed against the latest model version to identify any extreme outliers.
Download and review the results, which include inputs and outputs for each test case.
This feature helps ensure the model's reliability and performance.
In summary, Coherent provides a robust framework for managing Excel models as APIs, allowing for efficient governance, versioning, and testing.