x86: Serialize rdtsc in read_time()

Improves the accuracy of measurements, especially in short sections.

To quote the Intel 64 and IA-32 Architectures Software Developer's Manual:
"The RDTSC instruction is not a serializing instruction. It does not necessarily
wait until all previous instructions have been executed before reading the counter.
Similarly, subsequent instructions may begin execution before the read operation
is performed. If software requires RDTSC to be executed only after all previous
instructions have completed locally, it can either use RDTSCP (if the processor
supports that instruction) or execute the sequence LFENCE;RDTSC."

SSE2 is a requirement for lfence so only use it on SSE2-capable systems.
Prefer lfence;rdtsc over rdtscp since rdtscp is supported on fewer systems.

Signed-off-by: Luca Barbato <lu_zero@gentoo.org>
This commit is contained in:
Henrik Gramner 2015-07-08 22:33:53 +02:00 committed by Luca Barbato
parent 40af330adf
commit d1a6cb195f
1 changed files with 6 additions and 1 deletions

View File

@ -30,7 +30,12 @@
static inline uint64_t read_time(void)
{
uint32_t a, d;
__asm__ volatile("rdtsc" : "=a" (a), "=d" (d));
__asm__ volatile(
#if ARCH_X86_64 || defined(__SSE2__)
"lfence \n\t"
#endif
"rdtsc \n\t"
: "=a" (a), "=d" (d));
return ((uint64_t)d << 32) + a;
}