ProppFrexx crash

[phonic]

Got these two errors this morning. OS is Windows Server 2016 and been running without issue for a long time until recently.
I was not aware of the first until checking the logs, but the second did crash ProppFrexx altogether.

27/09/2021 07:00:52 [v4.2.6.3]:********** Message Notification **********
Message: UI Thread ID: 1, Current Thread ID: 40
Default Graphics: N/A, Shared Graphics: -570354819

DevExpress.Utils.v21.1, Version=21.1.5.0, Culture=neutral, PublicKeyToken=b88d1754d700e49a
####### Stack Trace ######

at yT.A0.DSpz(Object , FirstChanceExceptionEventArgs )
at System.Drawing.Graphics.GetHdc()
at DevExpress.Utils.Text.FontCache.CalculateMetrics(Graphics graphics, LOGFONT logFont)
at DevExpress.Utils.Text.FontCache..ctor(Graphics graphics, Font font)
at DevExpress.Utils.Text.FontsCache.GetFontCacheByFont(Graphics graphics, Font font)
at DevExpress.Utils.Text.TextUtils.GetStringSize(Graphics g, String text, Font font, StringFormat stringFormat, Int32 maxWidth, Int32 maxHeight, IWordBreakProvider wordBreakProvider, Boolean& isCropped)
at DevExpress.Utils.Text.TextUtils.GetStringSize(Graphics g, String text, Font font, StringFormat stringFormat, Int32 maxWidth, Int32 maxHeight, Boolean& isCropped)
at DevExpress.Utils.Paint.XPaintMixed.CalcTextSize(Graphics g, String s, Font font, StringFormat strFormat, Int32 maxWidth, Int32 maxHeight, Boolean& isCropped)
at DevExpress.Utils.Paint.XPaintMixed.CalcTextSize(Graphics g, String s, Font font, StringFormat strFormat, Int32 maxWidth)
at DevExpress.Utils.AppearanceObject.CalcTextSize(GraphicsCache cache, StringFormat sf, String s, Int32 width)
at DevExpress.XtraEditors.ViewInfo.LabelControlViewInfo.CalcSimpleTextSize(String Text, Boolean useHotkeyPrefix, LabelAutoSizeMode mode, Int32 predWidth, Int32 predHeight)
at DevExpress.XtraEditors.ViewInfo.LabelControlViewInfo.CalcTextSize(String Text, Boolean useHotkeyPrefix, LabelAutoSizeMode mode, Int32 predWidth, Int32 predHeight)
at DevExpress.XtraEditors.ViewInfo.LabelControlViewInfo.CalcTextSize(String Text, Boolean useHotkeyPrefix, LabelAutoSizeMode mode)
at DevExpress.XtraEditors.ViewInfo.LabelControlViewInfo.CalcTextSize(Boolean useHotkeyPrefix)
at DevExpress.XtraEditors.ViewInfo.LabelControlViewInfo.CalcTextPoints()
at DevExpress.XtraEditors.ViewInfo.LabelControlViewInfo.CalcContentRect(Rectangle bounds)
at DevExpress.XtraEditors.ViewInfo.BaseControlViewInfo.CalcRects()
at DevExpress.XtraEditors.ViewInfo.BaseControlViewInfo.CalcViewInfo(Graphics g)
at DevExpress.XtraEditors.LabelControl.LayoutChanged(Boolean isVisualUpdate)
at DevExpress.XtraEditors.LabelControl.OnTextChanged(EventArgs e)
at System.Windows.Forms.Control.set_Text(String value)
at ProppFrexx.Playlist.SetOnAirPlaytime(DJPlayer player, Double position, MediaEntry track)
at ProppFrexx.Playlist.hVBB()
at ProppFrexx.DJPlayer.xVX8(Int32 , Int32 , Int32 , SyncEvent )
at ProppFrexx.DJPlayer.<>c__DisplayClass493_0.CN7h()
at System.Threading.Tasks.Task.Execute()
at System.Threading.ExecutionContext.RunInternal(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx)
at System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx)
at System.Threading.Tasks.Task.ExecuteWithThreadLocal(Task& currentTaskSlot)
at System.Threading.Tasks.Task.ExecuteEntry(Boolean bPreventDoubleExecution)
at System.Threading.ThreadPoolWorkQueue.Dispatch()


********** Environment Stack Trace **********
at System.Environment.GetStackTrace(Exception e, Boolean needFileInfo)
at System.Environment.get_StackTrace()
at ProppFrexx.ProppFrexx_ONAIR.wScK(String )
at yT.A0.DSpz(Object , FirstChanceExceptionEventArgs )
at System.Drawing.Graphics.GetHdc()
at DevExpress.Utils.Text.FontCache.CalculateMetrics(Graphics graphics, LOGFONT logFont)
at DevExpress.Utils.Text.FontCache..ctor(Graphics graphics, Font font)
at DevExpress.Utils.Text.FontsCache.GetFontCacheByFont(Graphics graphics, Font font)
at DevExpress.Utils.Text.TextUtils.GetStringSize(Graphics g, String text, Font font, StringFormat stringFormat, Int32 maxWidth, Int32 maxHeight, IWordBreakProvider wordBreakProvider, Boolean& isCropped)
at DevExpress.Utils.Text.TextUtils.GetStringSize(Graphics g, String text, Font font, StringFormat stringFormat, Int32 maxWidth, Int32 maxHeight, Boolean& isCropped)
at DevExpress.Utils.Paint.XPaintMixed.CalcTextSize(Graphics g, String s, Font font, StringFormat strFormat, Int32 maxWidth, Int32 maxHeight, Boolean& isCropped)
at DevExpress.Utils.Paint.XPaintMixed.CalcTextSize(Graphics g, String s, Font font, StringFormat strFormat, Int32 maxWidth)
at DevExpress.Utils.AppearanceObject.CalcTextSize(GraphicsCache cache, StringFormat sf, String s, Int32 width)
at DevExpress.XtraEditors.ViewInfo.LabelControlViewInfo.CalcSimpleTextSize(String Text, Boolean useHotkeyPrefix, LabelAutoSizeMode mode, Int32 predWidth, Int32 predHeight)
at DevExpress.XtraEditors.ViewInfo.LabelControlViewInfo.CalcTextSize(String Text, Boolean useHotkeyPrefix, LabelAutoSizeMode mode, Int32 predWidth, Int32 predHeight)
at DevExpress.XtraEditors.ViewInfo.LabelControlViewInfo.CalcTextSize(String Text, Boolean useHotkeyPrefix, LabelAutoSizeMode mode)
at DevExpress.XtraEditors.ViewInfo.LabelControlViewInfo.CalcTextSize(Boolean useHotkeyPrefix)
at DevExpress.XtraEditors.ViewInfo.LabelControlViewInfo.CalcTextPoints()
at DevExpress.XtraEditors.ViewInfo.LabelControlViewInfo.CalcContentRect(Rectangle bounds)
at DevExpress.XtraEditors.ViewInfo.BaseControlViewInfo.CalcRects()
at DevExpress.XtraEditors.ViewInfo.BaseControlViewInfo.CalcViewInfo(Graphics g)
at DevExpress.XtraEditors.LabelControl.LayoutChanged(Boolean isVisualUpdate)
at DevExpress.XtraEditors.LabelControl.OnTextChanged(EventArgs e)
at System.Windows.Forms.Control.set_Text(String value)
at ProppFrexx.Playlist.SetOnAirPlaytime(DJPlayer player, Double position, MediaEntry track)
at ProppFrexx.Playlist.hVBB()
at ProppFrexx.DJPlayer.xVX8(Int32 , Int32 , Int32 , SyncEvent )
at ProppFrexx.DJPlayer.<>c__DisplayClass493_0.CN7h()
at System.Threading.Tasks.Task.Execute()
at System.Threading.ExecutionContext.RunInternal(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx)
at System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx)
at System.Threading.Tasks.Task.ExecuteWithThreadLocal(Task& currentTaskSlot)
at System.Threading.Tasks.Task.ExecuteEntry(Boolean bPreventDoubleExecution)
at System.Threading.ThreadPoolWorkQueue.Dispatch()
********** End **********

27/09/2021 09:00:43 [v4.2.6.3]:********** Message Notification **********
Message: UI Thread ID: 1, Current Thread ID: 27
Default Graphics: N/A, Shared Graphics: 1577130068

DevExpress.Utils.v21.1, Version=21.1.5.0, Culture=neutral, PublicKeyToken=b88d1754d700e49a
####### Stack Trace ######

at yT.A0.DSpz(Object , FirstChanceExceptionEventArgs )
at System.Drawing.Graphics.GetHdc()
at yT.A0.DSpz(Object , FirstChanceExceptionEventArgs )
at System.Drawing.Graphics.GetHdc()
at yT.A0.DSpz(Object , FirstChanceExceptionEventArgs )
at System.Drawing.Graphics.GetHdc()
at yT.A0.DSpz(Object , FirstChanceExceptionEventArgs )
at System.Drawing.Graphics.GetHdc()
at yT.A0.DSpz(Object , FirstChanceExceptionEventArgs )
at System.Drawing.Graphics.GetHdc()
at yT.A0.DSpz(Object , FirstChanceExceptionEventArgs )
at System.Drawing.Graphics.GetHdc()
at DevExpress.Utils.Text.FontCache.CalculateMetrics(Graphics graphics, LOGFONT logFont)
at DevExpress.Utils.Text.FontCache..ctor(Graphics graphics, Font font)
at DevExpress.Utils.Text.FontsCache.GetFontCacheByFont(Graphics graphics, Font font)
at DevExpress.Utils.Text.TextUtils.GetStringSize(Graphics g, String text, Font font, StringFormat stringFormat, Int32 maxWidth, Int32 maxHeight, IWordBreakProvider wordBreakProvider, Boolean& isCropped)
at DevExpress.Utils.Text.TextUtils.GetStringSize(Graphics g, String text, Font font, StringFormat stringFormat, Int32 maxWidth, Int32 maxHeight, Boolean& isCropped)
at DevExpress.Utils.Paint.XPaintMixed.CalcTextSize(Graphics g, String s, Font font, StringFormat strFormat, Int32 maxWidth, Int32 maxHeight, Boolean& isCropped)
at DevExpress.Utils.Paint.XPaintMixed.CalcTextSize(Graphics g, String s, Font font, StringFormat strFormat, Int32 maxWidth)
at DevExpress.Utils.AppearanceObject.CalcTextSize(GraphicsCache cache, StringFormat sf, String s, Int32 width)
at DevExpress.XtraEditors.ViewInfo.LabelControlViewInfo.CalcSimpleTextSize(String Text, Boolean useHotkeyPrefix, LabelAutoSizeMode mode, Int32 predWidth, Int32 predHeight)
at DevExpress.XtraEditors.ViewInfo.LabelControlViewInfo.CalcTextSize(String Text, Boolean useHotkeyPrefix, LabelAutoSizeMode mode, Int32 predWidth, Int32 predHeight)
at DevExpress.XtraEditors.ViewInfo.LabelControlViewInfo.CalcTextSize(String Text, Boolean useHotkeyPrefix, LabelAutoSizeMode mode)
at DevExpress.XtraEditors.ViewInfo.LabelControlViewInfo.CalcTextSize(Boolean useHotkeyPrefix)
at DevExpress.XtraEditors.ViewInfo.LabelControlViewInfo.CalcTextPoints()
at DevExpress.XtraEditors.ViewInfo.LabelControlViewInfo.CalcContentRect(Rectangle bounds)
at DevExpress.XtraEditors.ViewInfo.BaseControlViewInfo.CalcRects()
at DevExpress.XtraEditors.ViewInfo.BaseControlViewInfo.CalcViewInfo(Graphics g)
at DevExpress.XtraEditors.LabelControl.LayoutChanged(Boolean isVisualUpdate)
at DevExpress.XtraEditors.LabelControl.OnTextChanged(EventArgs e)
at System.Windows.Forms.Control.set_Text(String value)
at ProppFrexx.Playlist.SetOnAirPlaytime(DJPlayer player, Double position, MediaEntry track)
at ProppFrexx.Playlist.hVBB()
at ProppFrexx.DJPlayer.xVX8(Int32 , Int32 , Int32 , SyncEvent )
at ProppFrexx.DJPlayer.<>c__DisplayClass493_0.CN7h()
at System.Threading.Tasks.Task.Execute()
at System.Threading.ExecutionContext.RunInternal(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx)
at System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx)
at System.Threading.Tasks.Task.ExecuteWithThreadLocal(Task& currentTaskSlot)
at System.Threading.Tasks.Task.ExecuteEntry(Boolean bPreventDoubleExecution)
at System.Threading.ThreadPoolWorkQueue.Dispatch()


********** Environment Stack Trace **********
at System.Environment.GetStackTrace(Exception e, Boolean needFileInfo)
at System.Environment.get_StackTrace()
at ProppFrexx.ProppFrexx_ONAIR.wScK(String )
at yT.A0.DSpz(Object , FirstChanceExceptionEventArgs )
at System.Drawing.Graphics.GetHdc()
at yT.A0.DSpz(Object , FirstChanceExceptionEventArgs )
at System.Drawing.Graphics.GetHdc()
at yT.A0.DSpz(Object , FirstChanceExceptionEventArgs )
at System.Drawing.Graphics.GetHdc()
at yT.A0.DSpz(Object , FirstChanceExceptionEventArgs )
at System.Drawing.Graphics.GetHdc()
at yT.A0.DSpz(Object , FirstChanceExceptionEventArgs )
at System.Drawing.Graphics.GetHdc()
at yT.A0.DSpz(Object , FirstChanceExceptionEventArgs )
at System.Drawing.Graphics.GetHdc()
at DevExpress.Utils.Text.FontCache.CalculateMetrics(Graphics graphics, LOGFONT logFont)
at DevExpress.Utils.Text.FontCache..ctor(Graphics graphics, Font font)
at DevExpress.Utils.Text.FontsCache.GetFontCacheByFont(Graphics graphics, Font font)
at DevExpress.Utils.Text.TextUtils.GetStringSize(Graphics g, String text, Font font, StringFormat stringFormat, Int32 maxWidth, Int32 maxHeight, IWordBreakProvider wordBreakProvider, Boolean& isCropped)
at DevExpress.Utils.Text.TextUtils.GetStringSize(Graphics g, String text, Font font, StringFormat stringFormat, Int32 maxWidth, Int32 maxHeight, Boolean& isCropped)
at DevExpress.Utils.Paint.XPaintMixed.CalcTextSize(Graphics g, String s, Font font, StringFormat strFormat, Int32 maxWidth, Int32 maxHeight, Boolean& isCropped)
at DevExpress.Utils.Paint.XPaintMixed.CalcTextSize(Graphics g, String s, Font font, StringFormat strFormat, Int32 maxWidth)
at DevExpress.Utils.AppearanceObject.CalcTextSize(GraphicsCache cache, StringFormat sf, String s, Int32 width)
at DevExpress.XtraEditors.ViewInfo.LabelControlViewInfo.CalcSimpleTextSize(String Text, Boolean useHotkeyPrefix, LabelAutoSizeMode mode, Int32 predWidth, Int32 predHeight)
at DevExpress.XtraEditors.ViewInfo.LabelControlViewInfo.CalcTextSize(String Text, Boolean useHotkeyPrefix, LabelAutoSizeMode mode, Int32 predWidth, Int32 predHeight)
at DevExpress.XtraEditors.ViewInfo.LabelControlViewInfo.CalcTextSize(String Text, Boolean useHotkeyPrefix, LabelAutoSizeMode mode)
at DevExpress.XtraEditors.ViewInfo.LabelControlViewInfo.CalcTextSize(Boolean useHotkeyPrefix)
at DevExpress.XtraEditors.ViewInfo.LabelControlViewInfo.CalcTextPoints()
at DevExpress.XtraEditors.ViewInfo.LabelControlViewInfo.CalcContentRect(Rectangle bounds)
at DevExpress.XtraEditors.ViewInfo.BaseControlViewInfo.CalcRects()
at DevExpress.XtraEditors.ViewInfo.BaseControlViewInfo.CalcViewInfo(Graphics g)
at DevExpress.XtraEditors.LabelControl.LayoutChanged(Boolean isVisualUpdate)
at DevExpress.XtraEditors.LabelControl.OnTextChanged(EventArgs e)
at System.Windows.Forms.Control.set_Text(String value)
at ProppFrexx.Playlist.SetOnAirPlaytime(DJPlayer player, Double position, MediaEntry track)
at ProppFrexx.Playlist.hVBB()
at ProppFrexx.DJPlayer.xVX8(Int32 , Int32 , Int32 , SyncEvent )
at ProppFrexx.DJPlayer.<>c__DisplayClass493_0.CN7h()
at System.Threading.Tasks.Task.Execute()
at System.Threading.ExecutionContext.RunInternal(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx)
at System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx)
at System.Threading.Tasks.Task.ExecuteWithThreadLocal(Task& currentTaskSlot)
at System.Threading.Tasks.Task.ExecuteEntry(Boolean bPreventDoubleExecution)
at System.Threading.ThreadPoolWorkQueue.Dispatch()
********** End **********

[radio42]

The messages/text you posted is actually 'only' a first change exception, but not a crash or real exception/error. This indicates, that something unusual happened, but, that it was gracefully handled.
Can you describe a bit further, what exactly happened, as those reports are only logged into the Error.log for sanity reasons to get as much details as possible. Those 'first chance' issues are not even displayed or shown to the user.

But from the log, it looks, like an issue happened during play back, when just the OnAir-Time was simply updated.
This error itself than happened during the display - so it could indicate a graphics driver issue.
But it could also be a memory error or any other IO issue beforehand.
This is hard to tell.

Can you reproduce the error? If yes, how?
Did the error happen after some change to the system - or really just all of a sudden?
Every system/application crash is recorded in the Windows Event Log - please post those details.
Did you reboot your system and did that help?

[phonic]

It was running fully automated following the schedule as normal. No manual actions were performed.

In the meantime I'll have a check if any hot fixes are available for .NET.

Here's the XML output for the event:

Log Name: Application
Source: Application Error
Date: 27/09/2021 09:00:43
Event ID: 1000
Task Category: (100)
Level: Error
Keywords: Classic
User: N/A
Computer: ns3083410
Description:
Faulting application name: ProppFrexx ONAIR.exe, version: 4.2.6.3, time stamp: 0x61484c67
Faulting module name: clr.dll, version: 4.8.4410.0, time stamp: 0x60d67191
Exception code: 0x80131506
Fault offset: 0x000000000048b915
Faulting process ID: 0x1010
Faulting application start time: 0x01d7b2e7252db77b
Faulting application path: C:\Program Files\radio42\ProppFrexx ONAIR\ProppFrexx ONAIR.exe
Faulting module path: C:\Windows\Microsoft.NET\Framework64\v4.0.30319\clr.dll
Report ID: 15484d76-2626-412a-9850-66a0f9db9be8
Faulting package full name:
Faulting package-relative application ID:
Event Xml:
<Event xmlns="http://schemas.microsoft.com/win/2004/08/events/event">
<System>
<Provider Name="Application Error" />
<EventID Qualifiers="0">1000</EventID>
<Level>2</Level>
<Task>100</Task>
<Keywords>0x80000000000000</Keywords>
<TimeCreated SystemTime="2021-09-27T08:00:43.695680900Z" />
<EventRecordID>20923</EventRecordID>
<Channel>Application</Channel>
<Computer>ns3083410</Computer>
<Security />
</System>
<EventData>
<Data>ProppFrexx ONAIR.exe</Data>
<Data>4.2.6.3</Data>
<Data>61484c67</Data>
<Data>clr.dll</Data>
<Data>4.8.4410.0</Data>
<Data>60d67191</Data>
<Data>80131506</Data>
<Data>000000000048b915</Data>
<Data>1010</Data>
<Data>01d7b2e7252db77b</Data>
<Data>C:\Program Files\radio42\ProppFrexx ONAIR\ProppFrexx ONAIR.exe</Data>
<Data>C:\Windows\Microsoft.NET\Framework64\v4.0.30319\clr.dll</Data>
<Data>15484d76-2626-412a-9850-66a0f9db9be8</Data>
<Data>
</Data>
<Data>
</Data>
</EventData>
</Event>

Application: ProppFrexx ONAIR.exe Framework Version: v4.0.30319 Description: The process was terminated due to an internal error in the .NET Runtime at IP 00007FFA8035B915 (00007FFA7FED0000) with exit code 80131506.

[phonic]

Just to add: Looking at the timings of both errors at 07:00.52 and 09:00.43 is interesting as this would be when the news is still playing out via the overlay scheduler. The one at 09:00.43 links with the application crash that closed ProppFrexx. I may try running crash dumps again to catch that exception.

[radio42]

I guess that is just a co-incident. But it of course puts the system under more pressure.
Even, if the error occurs inside the crl.dll, which is the .Net runtime, it indicates most of the times just a system or driver failure somewhere.

So there is unfortunately not much I can do about it or help.
To localize to root cause, you can only revert the verily last changes and updates or even look for driver or system updates available.

[phonic]

With regards to drivers, not much to see as it's a dedicated server without any dedicated hardware regarding graphics or sound.
Within ProppFrexx for sound it's using the ProppFrexx virtual audio driver. Very simple setup and only used as a backup in case of failure.

I'll see if I can catch it next time (if it happens again) and hopefully it will shed more light on the issue.

[radio42]

When you say no soundcard the sample rate would be emulated by the system clock (which might be quite inaccurate).
But when you say no dedicated hardware, I assume, that all the rest is fully virtualized?! So the issue can also be in the VM using the underlying hardware. Ie. the VM might have an issue using that hardware. Which might make it even more difficult to find the effective root reason.

Have you asked you VM vendor for any help?
I am a bit afraid, that this all might result in an endless ping pong of pointing to the other one.
But at the moment I would have no idea, except, that VMs are not always good at processing real-time apps, which are leveraging the hardware quite heavily, ProppFrexx is graphic intense, IO intense as well as audio intense.

[phonic]

When you say no soundcard the sample rate would be emulated by the system clock (which might be quite inaccurate).
But when you say no dedicated hardware, I assume, that all the rest is fully virtualized?! So the issue can also be in the VM using the underlying hardware. Ie. the VM might have an issue using that hardware. Which might make it even more difficult to find the effective root reason.

Have you asked you VM vendor for any help?
I am a bit afraid, that this all might result in an endless ping pong of pointing to the other one.
But at the moment I would have no idea, except, that VMs are not always good at processing real-time apps, which are leveraging the hardware quite heavily, ProppFrexx is graphic intense, IO intense as well as audio intense.

No, it's not a VM. It runs on a dedicated Dell server, but does not have any additional hardware you would expect like sound card / dedicated graphics to mess things up and is accessed remotely via a RDP session and only uses the ProppFrexx ONAIR build-in "Virtual Sub-Bus" to stream the audio.

I will get to the bottom of it

[phonic]

Note sure if this is related to the current issue but I've noticed recently that the layout is getting messed up with information messing and not resizing correctly, and loading a saved layout just makes things worse as noted in this screenshot(even the playlist and most tabs have vanished so you can't close it, not sure why it named it MyList2 when the scheduled playlist is named NightMusicMix.. I need to restart ProppFrexx to resolve the issue):

I restarting corrects the issue with title and playlist tab and top tabs are displaying correctly:

but resizing soon brings it back again:

With regards to the current issue, I think I've found the fault by checking the notifications logs, and does appear to happen when the overlay is open. I think this is because I changed the overlay window to open as a separate window and has started popping up even when minimised and could be an issue when a RDP client is no longer connected(as it always happens when no active RDP session). I’ll try putting the layout back to default layout so this does not happen and redirect the session to console so it continues with a working GUI when closed. Hopefully this will resolve the issue.

[radio42]

The layout seems unrelated to any crash. Resizing the view and size of the controls of course changes the look.
To me, the RDP seems to be the issue.