Analytics tracking enhancements #259

tombogle · 2026-01-06T14:35:40Z

This change is

…ning them.

Included some minor refactoring and code cleanup

Also, added missing DLL to Installer

Could not load file or assembly 'System.Text.Json, Version=9.0.0.0'

…by tests Added explicit method to call to report project progress. Included advances in completed stages in project progress analytics

andrew-polk

@andrew-polk reviewed 20 files and all commit messages, and made 1 comment.
Reviewable status: all files reviewed, 1 unresolved discussion (waiting on @tombogle).

src/SayMore/Model/Project.cs line 208 at r1 (raw file):

					if (personDelta > 0)
						properties["PersonsAdded"] = personDelta.ToString();

I guess you don't care about removal of sessions or persons? (assuming that is possible)

Same for media duration below

Deal with race condition to be able to track progress reliably. Remove unnecessary tracking of intermediate updates.

tombogle

@tombogle made 1 comment.
Reviewable status: 15 of 20 files reviewed, 1 unresolved discussion (waiting on @andrew-polk).

src/SayMore/Model/Project.cs line 208 at r1 (raw file):

Previously, andrew-polk wrote…

I guess you don't care about removal of sessions or persons? (assuming that is possible)

Same for media duration below

I'm thinking of "progress" as advancing toward some (nebulous) "completion point." While getting rid of cruft can also be a form of progress, it's not the main focus. There are several other things that I could take into account, such as archiving, but that is already a concretely trackable event. My hope is to have an "event" that more-or-less answers the question, did the user make measurable progress toward creation of a finished work during this SayMore session, as opposed to just going in and poking around.

andrew-polk · 2026-01-13T16:38:03Z

src/SayMore/Model/Project.cs line 208 at r1 (raw file):

Previously, tombogle (Tom Bogle) wrote…

I'm thinking of "progress" as advancing toward some (nebulous) "completion point." While getting rid of cruft can also be a form of progress, it's not the main focus. There are several other things that I could take into account, such as archiving, but that is already a concretely trackable event. My hope is to have an "event" that more-or-less answers the question, did the user make measurable progress toward creation of a finished work during this SayMore session, as opposed to just going in and poking around.

👍

andrew-polk

@andrew-polk reviewed 5 files and all commit messages, and made 1 comment.
Reviewable status: all files reviewed, 1 unresolved discussion (waiting on @tombogle).

src/SayMore/Model/Project.cs line 680 at r2 (raw file):

SetAdditionalMetsData

typo
SetAdditionalMetaData

Copilot

Copilot encountered an error and was unable to review this pull request. You can try again by re-requesting a review.

Copilot · 2026-01-13T17:08:53Z

src/SayMore/Model/Project.cs

+		public void TrackStatistics(StatisticsViewModel statisticsViewModel)
+		{ 
+			if (_statisticsViewModel != null)
+				_statisticsViewModel.FinishedGatheringStatisticsForAllFiles -= FinishedGatheringStatistics;
+
+			_statisticsViewModel = statisticsViewModel;
+			_statisticsViewModel.FinishedGatheringStatisticsForAllFiles += FinishedGatheringStatistics;
+			if (_statisticsViewModel.IsDataUpToDate)
+			{
+				// It either finished before we could hook the event, or we hit the race condition.
+				FinishedGatheringStatistics(_statisticsViewModel, null);
+			}
+		}
+
+		private void FinishedGatheringStatistics(object sender, EventArgs e)
+		{
+			_statisticsViewModel.FinishedGatheringStatisticsForAllFiles -= FinishedGatheringStatistics;
+			// Check for race condition (see above).
+			if (_progressStats != null)
+				return;
+
+			_progressStats = new ProgressStats(_statisticsViewModel);
+		}


The new analytics tracking functionality (TrackStatistics, ReportProgressIfAny, and ProgressStats class) lacks test coverage. Since the repository has comprehensive test coverage for both Project and StatisticsViewModel classes, similar test coverage should be added for these new analytics-related methods to verify correct tracking behavior and edge cases.

Copilot · 2026-01-13T17:08:53Z

src/SayMore/Model/Project.cs

+			// Check for race condition (see above).
+			if (_progressStats != null)
+				return;
+
+			_progressStats = new ProgressStats(_statisticsViewModel);


Potential race condition: _progressStats is accessed from multiple contexts (FinishedGatheringStatistics callback, ReportProgressIfAny, and Dispose) without synchronization. While the null check at line 971 helps, a more robust approach would be to use locking or Interlocked operations to ensure thread-safe access to this field, especially since the statistics gatherer runs on a background thread.

Suggested change

// Check for race condition (see above).

if (_progressStats != null)

return;

_progressStats = new ProgressStats(_statisticsViewModel);

// Use atomic initialization to avoid race conditions when multiple threads

// access _progressStats concurrently.

var newProgressStats = new ProgressStats(_statisticsViewModel);

if (Interlocked.CompareExchange(ref _progressStats, newProgressStats, null) != null)

{

// Another thread has already initialized _progressStats; discard this instance.

// If ProgressStats implements IDisposable, it should be disposed here.

}

Copilot

Pull request overview

Copilot reviewed 19 out of 20 changed files in this pull request and generated 2 comments.

Files not reviewed (1)

src/SayMore/UI/SplashScreenForm.Designer.cs: Language not supported

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

src/SayMore/Model/Project.cs

Copilot · 2026-01-13T18:58:24Z

src/SayMore/Model/Project.cs

+		public void TrackStatistics(StatisticsViewModel statisticsViewModel)
+		{ 
+			if (_statisticsViewModel != null)
+				_statisticsViewModel.FinishedGatheringStatisticsForAllFiles -= FinishedGatheringStatistics;
+
+			_statisticsViewModel = statisticsViewModel;
+			_statisticsViewModel.FinishedGatheringStatisticsForAllFiles += FinishedGatheringStatistics;
+			if (_statisticsViewModel.IsDataUpToDate)
+			{
+				// It either finished before we could hook the event, or we hit the race condition.
+				FinishedGatheringStatistics(_statisticsViewModel, null);
+			}
+		}


The new TrackStatistics method and analytics tracking logic lack test coverage. Consider adding tests to verify: 1) TrackStatistics is called when StatisticsViewModel is created, 2) ReportProgressIfAny correctly tracks deltas, 3) Analytics.Track is called with expected properties.

We don't generally test Analytics code. Given the asyncronous nature of the statistics collection, it's probably not worth the trouble to introduce potentially flaky tests.

tombogle

@tombogle made 3 comments and resolved 1 discussion.
Reviewable status: all files reviewed, 3 unresolved discussions (waiting on @andrew-polk).

src/SayMore/Model/Project.cs line 680 at r2 (raw file):

Previously, andrew-polk wrote…

SetAdditionalMetsData

typo
SetAdditionalMetaData

It really is METS. It's an acronym for Metadata Encoding and Transmission Standard (https://www.loc.gov/standards/mets/)

src/SayMore/Model/Project.cs

tombogle · 2026-01-13T19:29:59Z

src/SayMore/Model/Project.cs

+		public void TrackStatistics(StatisticsViewModel statisticsViewModel)
+		{ 
+			if (_statisticsViewModel != null)
+				_statisticsViewModel.FinishedGatheringStatisticsForAllFiles -= FinishedGatheringStatistics;
+
+			_statisticsViewModel = statisticsViewModel;
+			_statisticsViewModel.FinishedGatheringStatisticsForAllFiles += FinishedGatheringStatistics;
+			if (_statisticsViewModel.IsDataUpToDate)
+			{
+				// It either finished before we could hook the event, or we hit the race condition.
+				FinishedGatheringStatistics(_statisticsViewModel, null);
+			}
+		}


We don't generally test Analytics code. Given the asyncronous nature of the statistics collection, it's probably not worth the trouble to introduce potentially flaky tests.

andrew-polk

@andrew-polk resolved 1 discussion and dismissed @copilot[bot] from a discussion.
Reviewable status: all files reviewed, 2 unresolved discussions (waiting on @tombogle).

Copilot · 2026-01-13T20:26:15Z

@andrew-polk I've opened a new pull request, #261, to work on those changes. Once the pull request is ready, I'll request review from you.

andrew-polk · 2026-01-13T20:26:57Z

Sigh. I don't know why copilot did that. Closing it.

tombogle added 3 commits December 12, 2025 12:20

Added information about projects and events to track creating and ope…

54b5fc4

…ning them.

Merge branch 'main' into analytics-tracking-enhancements

da7147c

Added an event to note details of significant progress.

393b97b

Included some minor refactoring and code cleanup

tombogle requested a review from andrew-polk January 6, 2026 14:35

tombogle self-assigned this Jan 6, 2026

tombogle added 6 commits January 6, 2026 09:50

Fixed problems when stats are not fully initialized

5768024

Upgraded SIL.DesktopAnalytics

edbca9f

Also, added missing DLL to Installer

Merge branch 'main' into analytics-tracking-enhancements

b3a4bf2

Unified on System.Text.Json 9.0.0 to prevent runtime failure:

016fab7

Could not load file or assembly 'System.Text.Json, Version=9.0.0.0'

Improved installer to avoid picking up older DLL versions referenced …

c71c5fd

…by tests Added explicit method to call to report project progress. Included advances in completed stages in project progress analytics

andrew-polk reviewed Jan 13, 2026

View reviewed changes

Revert errant installer change

ff5e863

Deal with race condition to be able to track progress reliably. Remove unnecessary tracking of intermediate updates.

tombogle commented Jan 13, 2026

View reviewed changes

andrew-polk approved these changes Jan 13, 2026

View reviewed changes

andrew-polk requested a review from Copilot January 13, 2026 17:02

Copilot started reviewing on behalf of andrew-polk January 13, 2026 17:03 View session

Copilot AI reviewed Jan 13, 2026

View reviewed changes

andrew-polk requested a review from Copilot January 13, 2026 18:55

Copilot started reviewing on behalf of andrew-polk January 13, 2026 18:55 View session

Copilot AI reviewed Jan 13, 2026

View reviewed changes

tombogle commented Jan 13, 2026

View reviewed changes

andrew-polk approved these changes Jan 13, 2026

View reviewed changes

Copilot AI mentioned this pull request Jan 13, 2026

[WIP] Add changes to address feedback on analytics tracking PR #261

Closed

-			// Check for race condition (see above).
-			if (_progressStats != null)
-				return;
-			_progressStats = new ProgressStats(_statisticsViewModel);
+			// Use atomic initialization to avoid race conditions when multiple threads
+			// access _progressStats concurrently.
+			var newProgressStats = new ProgressStats(_statisticsViewModel);
+			if (Interlocked.CompareExchange(ref _progressStats, newProgressStats, null) != null)
+			{
+				// Another thread has already initialized _progressStats; discard this instance.
+				// If ProgressStats implements IDisposable, it should be disposed here.
+			}

Uh oh!

Analytics tracking enhancements #259

Are you sure you want to change the base?

Analytics tracking enhancements #259

Uh oh!

Conversation

tombogle commented Jan 6, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

andrew-polk left a comment

Choose a reason for hiding this comment

Uh oh!

tombogle left a comment

Choose a reason for hiding this comment

Uh oh!

andrew-polk commented Jan 13, 2026

Uh oh!

andrew-polk left a comment

Choose a reason for hiding this comment

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Uh oh!

Copilot AI Jan 13, 2026

Choose a reason for hiding this comment

Uh oh!

Copilot AI Jan 13, 2026

Choose a reason for hiding this comment

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Uh oh!

Uh oh!

Copilot AI Jan 13, 2026

Choose a reason for hiding this comment

Uh oh!

tombogle Jan 13, 2026

Choose a reason for hiding this comment

Uh oh!

tombogle left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

tombogle Jan 13, 2026

Choose a reason for hiding this comment

Uh oh!

andrew-polk left a comment

Choose a reason for hiding this comment

Uh oh!

Copilot AI commented Jan 13, 2026

Uh oh!

andrew-polk commented Jan 13, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

tombogle commented Jan 6, 2026 •

edited

Loading