• Save 15% on ALL SFF Network merch, until Dec 31st! Use code SFF2024 at checkout. Click here!

Discussion Performance per litre - Round 4

morj

Airflow Optimizer
Bronze Supporter
Feb 11, 2020
362
695
Did you have to get rid of something for that?

Yeah, they got rid of the active SSD heatsink, so no big deal. SSD performance is not measured by PPL.

Also mad props to minisforum, they released basically an off-the-shelf solution with crazy high PPL. With such products available there's a really slim chance a build with top of the line GPU (say RTX 4090) can hit it.

Consider this: to get 2M PPL (assuming same CPU score of 12775) a build with a 4090 (which has around 33500 GPU score) must have a volume of approximately 1.6L:

log_1.5 ((12775 * 33500) / (100 * 2000000)) ~= 1.66

(12775 * 33500) / (1.66 ^ 1.5) / 100 ~= 2000984

For reference, Dell OEM 4070 GPU (smallest 4070) is around 1L in volume (with PCI slot excluded).
 

chinevo

SFF Recordsman
May 11, 2017
159
279
Congrats, impressive scoring!
How quiet is this tiny thing?
Surprisingly very quiet and completely silent when idle. I think it's due to liquid metal.
Watch this and this videos for more info about noise.

What you did is keeping the inner stock casing and replacing the top and bottom panels with thinner ones, right?
Only replaced the top and bottom panels

Stock vs Custom:

Did you have to get rid of something for that?
Yes, I got rid of the active SSD heatsink

source: https://www.techradar.com/pro/minisforum-mercury-em780-review

No DC barrel here, GaN USB-C charger fully compatible with this board.
USB-C 5A limit is respected with this low power 65W, but what about the problem with the USB Power Delivery reported earlier with such Gan chargers?
Does the board have an integrated 'USB-PD dummy trigger PCB'?
What do you guys think, @msystems, @SFFMunkee ?
Any usb-c chargers, that I tried, works well - apple, xiaomi, stock, rozetka.
But usb-c port on the front don't charge my wireless mouse or keyboard.

Please show us a picture of it next to a soda can 😄
Yes, sure ;)
 

morj

Airflow Optimizer
Bronze Supporter
Feb 11, 2020
362
695
By the way, this whole thing got me thinking about the PPL formula. Why are we measuring performance per cm^4.5?

Explanation: 1 liter is 1000 cm^3 (cubic centimeter). So the formula has Build Volume^1.5, which makes it (cm^3)^1.5 which is (cm^4.5). Performance per something that is over 4 dimensions 😱

Moreover, for builds of, say 4L in volume we have 4^1.5 = 8, so actually 2 times the volume (of penalty) due to this exponent.

On the other hand for a build of 0.25L volume we have 0.25 ^ 1.5 = 0.125, so actually 2 times LESS the volume due to this exponent.

So basically the exponent in the formula IMMENSELY favors the < 1L builds due to the way exponents work. We are looking at like 4x advantage over a "normal" build.

EXAMPLES:


@petricor's build without the exponent: (34,565*33,304)/(5)/100 = 2302305.52

@chinevo's build without the exponent: (12775 * 2688) / ((0.198 + 0.053)) / 100 = 1368095.61753

Is this feature of the PPL formula intentional?
 

chinevo

SFF Recordsman
May 11, 2017
159
279
By the way, this whole thing got me thinking about the PPL formula. Why are we measuring performance per cm^4.5?

Explanation: 1 liter is 1000 cm^3 (cubic centimeter). So the formula has Build Volume^1.5, which makes it (cm^3)^1.5 which is (cm^4.5). Performance per something that is over 4 dimensions 😱

Moreover, for builds of, say 4L in volume we have 4^1.5 = 8, so actually 2 times the volume (of penalty) due to this exponent.

On the other hand for a build of 0.25L volume we have 0.25 ^ 1.5 = 0.125, so actually 2 times LESS the volume due to this exponent.

So basically the exponent in the formula IMMENSELY favors the < 1L builds due to the way exponents work. We are looking at like 4x advantage over a "normal" build.

EXAMPLES:


@petricor's build without the exponent: (34,565*33,304)/(5)/100 = 2302305.52

@chinevo's build without the exponent: (12775 * 2688) / ((0.198 + 0.053)) / 100 = 1368095.61753

Is this feature of the PPL formula intentional?
Oh yes, the rating is unfair because @petricor is not in the first place 😀

It's a joke. To put it seriously, the rating is really unfair cause we have performance ^ 2 (performance*performance) in the numerator and volume ^ 1.5 in the denominator. So, performance has more weight than volume. The fair formula, in my opinion, should look like <performance>^1/<volume>^1 (performance per liter). For example: (Multipier1*<GPU score> + Multipier2*<CPU score>) /<Volume>. Or separate ratings for GPU and CPU: <CPU score>/<Volume> and <GPU score>/<Volume>

For example, gamers have simple formulas
<Average FPS> / <Price> or <Performance> / <Watt>
rather than something like this:
<FPS in game1>*<FPS in game 2>/ Dollar ^ 1.5
or
<Performance1>*<Performance2>*<Performance3>/ Watt ^ 2

Good point, seems nobody expected sub 1L builds 🤔

Maybe it's time for a new round with update calculation?
"Competition ends at 25 entries (new round with new benches starts after)"

So, we need 6 more entries and go for round 5
 
Last edited:

morj

Airflow Optimizer
Bronze Supporter
Feb 11, 2020
362
695
Oh yes, the rating is unfair because @petricor is not in the first place 😀

I'm not saying the rating is unfair, I was just trying to understand how the minisforum PC beat is so easily. Based on the raw numbers, the performance is not proportional to the volume, but the rating is off the scale.

I mean, it's not fun when something you can just go and buy for 600 EUR blows everything custom (like @petricor or @guryhwa builds) out of the water. 😉
 

msystems

King of Cable Management
Apr 28, 2017
804
1,405
I would assume the purpose of the exponent is to reward going smaller in general. If there are two builds which have proportionally the same performance, the exponent function causes the smaller one to receive a bonus. I find this is somewhat logical for ITX desktops because the smaller you go, the more inefficient your build is, because you have things which are standardized/ fixed in volume, requiring more extreme customization the smaller you go.

But indeed, when the total volume is less than 1, it causes a bit crazy results. It needs a clamp on the lower bound of the volume.

I'm not sure what the best mathematical approach is, but i propose that builds with a total volume under 1L should omit the exponent from their ppl calculation.

That would still give the build above a colossal 1.3M score, but not a broken one.
 
  • Like
Reactions: SFFMunkee

r0ger

Cable Smoosher
Jan 1, 2024
10
6
Hi,

For small machines where the cooling system is shared by the CPU and the GPU, it is important to do the CPU and GPU benchmarks at the same time

In my nuc with passmark benchmark (setting duration very long), the cpu benchmark is 22,500pts, the igpu benchmark is 3,000pts, if I launch at the same time it drops to around 60%
 
  • Like
Reactions: riba2233 and morj

chinevo

SFF Recordsman
May 11, 2017
159
279
Hi,

For small machines where the cooling system is shared by the CPU and the GPU, it is important to do the CPU and GPU benchmarks at the same time

In my nuc with passmark benchmark (setting duration very long), the cpu benchmark is 22,500pts, the igpu benchmark is 3,000pts, if I launch at the same time it drops to around 60%
Important for what? To get a worse results? I prefer better 😀

PS: maybe it can be helpful for somebody. Here you can download 3D model files of my custom EM780 panels
 

r0ger

Cable Smoosher
Jan 1, 2024
10
6
it's sure, it suits you 😀

but it's always interesting to know the results of the mini pc when using cpu+gpu in the same time
 

confusis

John Morrison. Founder and Team Leader of SFF.N
SFF Network
SFF Workshop
SFFn Staff
Jun 19, 2015
4,325
7,425
sff.network
ASRock DeskMini X600
Ryzen 5 8600G
2x 16GB Teamgroup Elite DDR5-5600

DeskMini X600 Dimensions - 155 x 155 x 80 mm (1.92L)
Power Brick: 120w GAN supplied with DeskMini: 65 x 98 x 23mm (0.14L)
Total volume: 2.06L

Score: ((12870 x 2372)/ (2.06 x 1.5)) /100
(30527640/ 3.09) /100
98,794.95

System pics will be in the upcoming review article :p

Forgot the GPU-Z instance but I'm sure this'll do.

Screenshot 2024-05-17 193208.png
 

SFFMunkee

Buy first, justify later?
Gold Supporter
Jul 7, 2021
944
1,013
ASRock DeskMini X600
Ryzen 5 8600G
2x 16GB Teamgroup Elite DDR5-5600

DeskMini X600 Dimensions - 155 x 155 x 80 mm (1.92L)
Power Brick: 120w GAN supplied with DeskMini: 65 x 98 x 23mm (0.14L)
Total volume: 2.06L

Score: ((12870 x 2372)/ (2.06 x 1.5)) /100
(30527640/ 3.09) /100
98,794.95

System pics will be in the upcoming review article :p

Forgot the GPU-Z instance but I'm sure this'll do.

View attachment 3359
CPU and GPU scores both seem low?
What's the RAM running at?

::EDIT:: Just tested my 5600G on my boring daily / stable settings - except I had to go back to BIOS and enable the iGPU and force it to be primary output.
Weirdly my CPU score is dreadful - maybe I should've waited a bit after restarting lolll

Second run the CPU performance is still way lower than I'd expect (in my PPL test I got 8840 CPU points..?) but whatever - I'd have expected the 8600G to smash the 5600G.

Ah well - we'll see what it can do when I get tinkering ;)
 
Last edited:
  • Like
Reactions: riba2233

confusis

John Morrison. Founder and Team Leader of SFF.N
SFF Network
SFF Workshop
SFFn Staff
Jun 19, 2015
4,325
7,425
sff.network
CPU and GPU scores both seem low?
What's the RAM running at?

::EDIT:: Just tested my 5600G on my boring daily / stable settings - except I had to go back to BIOS and enable the iGPU and force it to be primary output.
Weirdly my CPU score is dreadful - maybe I should've waited a bit after restarting lolll

Second run the CPU performance is still way lower than I'd expect (in my PPL test I got 8840 CPU points..?) but whatever - I'd have expected the 8600G to smash the 5600G.

Ah well - we'll see what it can do when I get tinkering ;)
5600, stock settings on this one.
 

Steven

Efficiency Noob
Aug 5, 2024
7
11
Hi all,

We were talking about formulas and what would most accurately define the title "performance per liter". I've come up with a solution to this using the geometric mean (instead of the proposed arithmetic mean) of the performance numbers. Sqrt(cpu_r23*gpu_timespy)/Volume

The benefit of this is threefold: 1) there is no need for arbitrary multipliers to combine the scores 2) This ACTUALLY gives performance^1 and volume^1 as the label "PPL" claims. 3) the scores will now progress more linearly meaning numbers won't grow ridiculously large in short time, giving the formula longevity without a need to scale it.

I've run this new formula through all the available data for this round, here is how it looks:

Old #Old ScoreNew PPL #New PPLLinkCine R23Timespy GraphicsVolume (with brick), LCPUGPU
#12,730,735123,346chinevo12,7752,6880.251AMD 7840UAMD 780M
#21,915,262210,806guryhwa65,00013,0002.69AMD EPYC 7742RTX 3070
#31,029,62246,786petricor34,56533,3045AMD 7950X3DRTX 4090
#4770,21437,998articnova20,1266,6821.45Intel 13900RTX A2000
#5504,01664,748petricor27,55420,4515AMD 5950xRTX 3090
#6419,89474,479AURMEND25,36714,9664.35AMD 3950xRTX 3070
#7374,24484,362REVOCCASES16,14017,6533.87AMD 7940HSRTX 4070
#8272,39654,756REVOCCASES7,3596,4631.45Intel 11700TRTX A2000
#9141,943132,390hereforthefeast16,58613,1166.17AMD 3900XRTX 3070
#10136,52493,302msystems15,0101,7911.57AMD 5700GAMD Vega8
#11127,017103,161dannycpham18,59013,3864.99AMD 5950XRTX 3070
#12114,540112,782Goatee6,0686,0632.18Intel 9600KRTX A2000
#13102,725152,108SFFMunkee11,30711,2115.34AMD 5600GRTX 4060
#1498,795122,682confusis12,8702,3722.06AMD 8600GAMD 760M
#1573,738142,213msystems14,7321,7132.27AMD 5700GAMD Vega8
#1670,696161,885Diamorif6,3598,7613.96AMD 3900RTX 2070
#1755,551181,560Damascus5,0535,2463.3Intel 6700GTX 1070
#1852,695171,604CubanLegend6,0987,4384.2Intel 7700KGTX 1080
#1923,75419903timginter6,7978,6798.51AMD 3500XRTX 2070
#2014,339
20​
776aromachi2,9856,4865.67AMD 1600GTX 1660 Ti
 

REVOCCASES

Shrink Ray Wielder
REVOCCASES
Silver Supporter
Apr 2, 2020
2,166
3,504
www.revoccases.com
Hi all,

We were talking about formulas and what would most accurately define the title "performance per liter". I've come up with a solution to this using the geometric mean (instead of the proposed arithmetic mean) of the performance numbers. Sqrt(cpu_r23*gpu_timespy)/Volume

The benefit of this is threefold: 1) there is no need for arbitrary multipliers to combine the scores 2) This ACTUALLY gives performance^1 and volume^1 as the label "PPL" claims. 3) the scores will now progress more linearly meaning numbers won't grow ridiculously large in short time, giving the formula longevity without a need to scale it.

so this new formula moves me up by 2 positions? I agree! XD
 

msystems

King of Cable Management
Apr 28, 2017
804
1,405
Hi all,

We were talking about formulas and what would most accurately define the title "performance per liter". I've come up with a solution to this using the geometric mean (instead of the proposed arithmetic mean) of the performance numbers. Sqrt(cpu_r23*gpu_timespy)/Volume

The benefit of this is threefold: 1) there is no need for arbitrary multipliers to combine the scores 2) This ACTUALLY gives performance^1 and volume^1 as the label "PPL" claims. 3) the scores will now progress more linearly meaning numbers won't grow ridiculously large in short time, giving the formula longevity without a need to scale it.

I've run this new formula through all the available data for this round, here is how it looks:

Old #Old ScoreNew PPL #New PPLLinkCine R23Timespy GraphicsVolume (with brick), LCPUGPU
#12,730,735123,346chinevo12,7752,6880.251AMD 7840UAMD 780M
#21,915,262210,806guryhwa65,00013,0002.69AMD EPYC 7742RTX 3070
#31,029,62246,786petricor34,56533,3045AMD 7950X3DRTX 4090
#4770,21437,998articnova20,1266,6821.45Intel 13900RTX A2000
#5504,01664,748petricor27,55420,4515AMD 5950xRTX 3090
#6419,89474,479AURMEND25,36714,9664.35AMD 3950xRTX 3070
#7374,24484,362REVOCCASES16,14017,6533.87AMD 7940HSRTX 4070
#8272,39654,756REVOCCASES7,3596,4631.45Intel 11700TRTX A2000
#9141,943132,390hereforthefeast16,58613,1166.17AMD 3900XRTX 3070
#10136,52493,302msystems15,0101,7911.57AMD 5700GAMD Vega8
#11127,017103,161dannycpham18,59013,3864.99AMD 5950XRTX 3070
#12114,540112,782Goatee6,0686,0632.18Intel 9600KRTX A2000
#13102,725152,108SFFMunkee11,30711,2115.34AMD 5600GRTX 4060
#1498,795122,682confusis12,8702,3722.06AMD 8600GAMD 760M
#1573,738142,213msystems14,7321,7132.27AMD 5700GAMD Vega8
#1670,696161,885Diamorif6,3598,7613.96AMD 3900RTX 2070
#1755,551181,560Damascus5,0535,2463.3Intel 6700GTX 1070
#1852,695171,604CubanLegend6,0987,4384.2Intel 7700KGTX 1080
#1923,75419903timginter6,7978,6798.51AMD 3500XRTX 2070
#2014,339
20​
776aromachi2,9856,4865.67AMD 1600GTX 1660 Ti


So this isn't better. Using the sqrt, it's compressing the higher performing builds by even worse. It's increasing the score gap between ultra small sbc and itx, when what was needed was to decrease this gap.

The original suggestion of changing the formula was to address for (1). the high relative advantage of using very small efficient ryzen mobile sbcs, and (2). under 1L it actually breaks the existing formula.
 

REVOCCASES

Shrink Ray Wielder
REVOCCASES
Silver Supporter
Apr 2, 2020
2,166
3,504
www.revoccases.com
TBH, why are we not using a straight and simple calculation as it was done in PPL round one?

1723043441401.png

we are talking about Performance / Liter and not Performance / Square Liter, Squareroot Performance / Liter, or whatever...

maybe add some other benchmarks or rules for the next round but keeping it simple is often the best solution - IMHO