Release PR for v1.15.0b1 - #509

…sts (#504)

* CU-8696nbm03: Remove use of unigram table

* CU-8696nbm03: Fix usage of new unigram table alternative

* CU-8696nbm03: Remove unigram table from loaded vocabs

* CU-8696nbm03: Add tests for unigram table usage/negative sampling frequency

* CU-8696nbm03: Add small comment to tests

* CU-8696nbm03: Calculate frequencies upon load if not present

* CU-8696nbm03: Update comment regarding probability calculatioons

* CU-8696nbm03: Remove commented test case

* CU-8696n7w95: Fix docstring issue

* CU-8696nbm03: Fix serialisation tests

* CU-8696nbm03: Add python 3.9-friendly method for getting the total of a counter

* CU-8695d4www: Bump pydantic requirement to 2.6+

* CU-8695d4www: Update methods to use pydantic2 based ones

* CU-8695d4www: Update methods to use pydantic2 based ones [part 2]

* CU-8695d4www: Use identifier based config when setting last train date on meta cat and tner

* CU-8695d4www: Use pydantic2-based model validation

* CU-8695d4www: Add workarounds for pydantic1 methods

* CU-8695d4www: Add missing utils module for pydantic1 methods

* Revert "CU-8695d4www: Bump pydantic requirement to 2.6+"

This reverts commit b0b3d43.

* CU-8695d4www: [TEMP] Add type-ingores to pydantic2-based methods for GHA workflow

* CU-8695d4www: Make pydantic2-requires getattribute wrapper only apply when appropriate

* CU-8695d4www: Fix missin model dump getter abstraction

* CU-8695d4www: Fix missin model dump getter abstraction (in CAT)

* CU-8695d4www: Update tests for pydantic 1 and 2 support

* Revert "CU-8695d4www: [TEMP] Add type-ingores to pydantic2-based methods for GHA workflow"

This reverts commit b86135a.

* Reapply "CU-8695d4www: Bump pydantic requirement to 2.6+"

This reverts commit 080ae71.

* CU-8695d4www: Allow both pydantic 1 and 2

* CU-8695d4www: Deprecated pydantic utils for removal in 1.15

* CU-8695d4www: Allow usage of specified deprecated method(s) during tests

* CU-8695d4www: Allow usage of pydantic 1-2 workaround methods during tests

* CU-8695d4www: Add documentation for argument allowing usage during tests in deprecation method

* CU-8695d4www: Fix allowing deprecation during test time

* CU-8695d4www: Fix model dump getting in regression checker

* Revert "CU-8695d4www: Fix allowing deprecation during test time"

This reverts commit fadc7d1.

* Revert "CU-8695d4www: Add documentation for argument allowing usage during tests in deprecation method"

This reverts commit 927f807.

* Revert "CU-8695d4www: Allow usage of pydantic 1-2 workaround methods during tests"

This reverts commit 825628e.

* Revert "CU-8695d4www: Allow usage of specified deprecated method(s) during tests"

This reverts commit a89e680.

* Revert "CU-8695d4www: Deprecated pydantic utils for removal in 1.15"

This reverts commit 0ee1a8a.

* CU-8695d4www: Add comment regarding pydantic backwards compatiblity where applicable

* CU-8695d4www: Add pydantic 1 check to GHA workflow

* CU-8695d4www: Fix usage of pydantic-1 based dict method in regression results

* CU-8695d4www: Fix usage of pydantic-1 based dict method in regression tests

* CU-8695d4www: New workflow step to install and run mypy on pydantic 1

* CU-8695d4www: Add type ignore comments to pydantic2 versions in versioning utils for typing during GHA workflow

* CU-8695d4www: Update pydantic requirement to 2.0+ only

* CU-8695d4www: Update to pydantic 2 ONLY

* CU-869671bn4: Update mypy dev requirement to be less than 1.12

* CU-869671bn4: Fix model fields in config

* CU-869671bn4: Fix stats helper method - use correct type adapter

* CU-869671bn4: Fix some model type issues

* CU-869671bn4: Line up with previous model dump methods

* CU-869671bn4: Fix overwriting model dump methods

* CU-869671bn4: Remove pydantic1 workflow step

…ting folds (#508)

* CU-8696v2j42: Add test to make sure per-cui counts are kept when creating folds

* CU-8696v2j42: Fix per annotation fold creation