Skip to content

Conversation

sschuberth
Copy link
Member

No description provided.

Copy link

codecov bot commented Feb 24, 2025

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 68.46%. Comparing base (feaf969) to head (bf33639).

Additional details and impacted files
@@            Coverage Diff            @@
##               main    #9961   +/-   ##
=========================================
  Coverage     68.46%   68.46%           
  Complexity     1309     1309           
=========================================
  Files           250      250           
  Lines          8881     8881           
  Branches        924      924           
=========================================
  Hits           6080     6080           
  Misses         2409     2409           
  Partials        392      392           
Flag Coverage Δ
test-ubuntu-24.04 36.16% <ø> (ø)
test-windows-2022 36.14% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@sschuberth sschuberth force-pushed the ort-result-schema-reporter branch 2 times, most recently from ccb246c to da1322b Compare February 25, 2025 07:24
This is mostly to assist the ORT community with writing external
tooling. But it could also be used to detect breaking ORT results
changes in the future, and introduce / bump an output file format
version.

Signed-off-by: Sebastian Schuberth <[email protected]>
@sschuberth sschuberth force-pushed the ort-result-schema-reporter branch from da1322b to bf33639 Compare February 25, 2025 07:26
@@ -0,0 +1,35 @@
/*
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

commit-msg:

This is mostly to assist the ORT community with writing external
tooling.

Didn't we say that the OrtResult format should not be depended upon externally as it is subject to change?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes, and this PR is not supposed to imply changing that. The ORT result file is and should stay an internal format that can change any time without notice. Which means that also this schema generated by this reporter can change any time. This was just meant as a quick support work for @heliocastro as requested on Slack.

But as I knew this would spawn discussions, I've not dared to take this out of draft state yet.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm just in the schema now, the current jackson support old type of jsonschema. Is ok for you if i update the PR @sschuberth ?

Copy link
Member Author

@sschuberth sschuberth Feb 25, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is ok for you if i update the PR @sschuberth ?

Update how? Even the latest version of jackson-module-jsonSchema only supports schema V3, and the fork at https://github.com/mbknor/mbknor-jackson-jsonSchema that is supposed to support newer schema versions has not been updated for 4 years.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'll give that one a try. However, we've discussed in today's core dev meeting that a reporter maybe is not the ideal place to implement this after all. I'll probably experiment with something over at https://github.com/sschuberth/ort-scripts.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm closing this PR in favor of the scripting approach. Please give the script a try @heliocastro.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I like this approach better

@sschuberth sschuberth closed this Feb 25, 2025
@sschuberth sschuberth deleted the ort-result-schema-reporter branch February 25, 2025 11:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants