Trouble is most of the world don't work that way.... :-( Also it is a moving target. Compilers evolve all the time.
Besides many choose (initial buy) price over anything else anyway.
No one trusts anyone to do that. They are also only going to shot off favourable benchmarks.
Because the benchmarks I get to see on occasions are for internal use by the engineers they are very fair and impartial down to noting exactly which versions and settings for each compiler.
The second you publish those some one will complain that the settings should be changed on their compiler for a particular test etc. (GCC people are some of the worst for this so no one bothers)
Sorry I have to ask marketing/legal/corperate before I answer that.... :-)
Well Keil tended to package most of the standard (drhy, whet, sieve) benchmarks with their compiler and they all fitted into the eval version. However the meaningful "real World" benchmarks are large amounts of real code and not something you can give away.
OK... So you are going to give up a few weeks of your life to do it? Free of charge? Doing this is not a simple task.
Yes
Dream on.... may be one day.... Perhaps a job for you when you have retired? If I am still sane I will give you a hand.
Absolutely. This is why there is no test suite worthy of the name for GCC. It takes an enormous amount of disciplined and diligent work.
Agreed. I know what I have seen but the minute I names names (or numbers) it is the last time I get any information on anything.
Agreed
That last comment is disingenuous.
Absolutely. Always have done. There is no "best" compiler in a practical sense. A lot depends where you are coming from and where you are going to.
Agreed. Support is another. Also what other tools it will work with and what functionality you need. For example it looks like the FDA (US medical authority) bless them have made up 30 years and now are likely to want not only static analysis but MCDC code coverage on the target.
SO the tools you will need for that are very different to a 4.99GBP mass produced air freshener.
Agreed.
I would disagree on that. The technology it uses is very old and not really suited to many MCU's
Agreed.
They are getting there.
I don't keep much of an eye on C++ at the moment (too busy)
Tell me about it... Causes us a lot of fun in MISRA with "effectively bool"
The problem with // comments is not the // but how the other end of the line was handled. However many if not most C90 compilers had that before the standard did.
Yes.
BTW I was arguing for the last decade that the ISO C panel should only add in and regularise things compilers were actually adding. On the grounds that if a feature really was required then compiler makers (commercial or otherwise) would add them as there was a real market.
Hmmmm not sure there. I knwo a lot of people doing embedded systems with screens and multiple non A-z alphabets.... Chinese, Arab, cyrilc etc all on the same device and programming with non-European keyboards.
Well I am never a fan of variable memory allocation, variable number of function parameters and variable length arrays in any embedded system.
Better no. There are some good ones doing Open Source. But then again there are some appalling ones. Everyone plays. The commercial (closed shop) development teams can keep a standard and have a much more controlled process.
That is true. However it is like playing bridge where the Gcc is the dummy hand. That is open. So the commercial people can see what is happening in the GCC world but not the other way around.
I would say most do. The reason is simply the practicality of running a large project. The commercial teams have a very rigorous system that must be used and they are in full control of it. This in itself makes a big difference.