RepoMirrors
/
musl
mirror of git://git.musl-libc.org/musl
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
musl/arch/x86_64/atomic_arch.h

117 lines
2.3 KiB
C
Raw Normal View History

clean up x86_64 (and x32) atomics for new atomics framework this commit mostly makes consistent things like spacing, function ordering in atomic_arch.h, argument names, use of volatile, etc. a_ctz_l was also removed from x86_64 since atomic.h provides it automatically using a_ctz_64.
2016-01-22 00:53:09 +00:00
#define a_cas a_cas
static inline int a_cas(volatile int *p, int t, int s)
Port musl to x86-64. One giant commit!
2011-02-15 12:32:09 +00:00
{
clean up x86_64 (and x32) atomics for new atomics framework this commit mostly makes consistent things like spacing, function ordering in atomic_arch.h, argument names, use of volatile, etc. a_ctz_l was also removed from x86_64 since atomic.h provides it automatically using a_ctz_64.
2016-01-22 00:53:09 +00:00
__asm__ __volatile__ (
"lock ; cmpxchg %3, %1"
: "=a"(t), "=m"(*p) : "a"(t), "r"(s) : "memory" );
return t;
Port musl to x86-64. One giant commit!
2011-02-15 12:32:09 +00:00
}
refactor internal atomic.h rather than having each arch provide its own atomic.h, there is a new shared atomic.h in src/internal which pulls arch-specific definitions from arc/$(ARCH)/atomic_arch.h. the latter can be extremely minimal, defining only a_cas or new ll/sc type primitives which the shared atomic.h will use to construct everything else. this commit avoids making heavy changes to the individual archs' atomic implementations. definitions which are identical or near-identical to what the new shared atomic.h would produce have been removed, but otherwise the changes made are just hooking up the arch-specific files to the new infrastructure. major changes to take advantage of the new system will come in subsequent commits.
2016-01-21 19:08:54 +00:00
#define a_cas_p a_cas_p
Port musl to x86-64. One giant commit!
2011-02-15 12:32:09 +00:00
static inline void *a_cas_p(volatile void *p, void *t, void *s)
{
__asm__( "lock ; cmpxchg %3, %1"
clean up x86_64 (and x32) atomics for new atomics framework this commit mostly makes consistent things like spacing, function ordering in atomic_arch.h, argument names, use of volatile, etc. a_ctz_l was also removed from x86_64 since atomic.h provides it automatically using a_ctz_64.
2016-01-22 00:53:09 +00:00
: "=a"(t), "=m"(*(void *volatile *)p)
: "a"(t), "r"(s) : "memory" );
Port musl to x86-64. One giant commit!
2011-02-15 12:32:09 +00:00
return t;
}
clean up x86_64 (and x32) atomics for new atomics framework this commit mostly makes consistent things like spacing, function ordering in atomic_arch.h, argument names, use of volatile, etc. a_ctz_l was also removed from x86_64 since atomic.h provides it automatically using a_ctz_64.
2016-01-22 00:53:09 +00:00
#define a_swap a_swap
static inline int a_swap(volatile int *p, int v)
optimize contended normal mutex case; add int compare-and-swap atomic
2011-03-17 16:14:40 +00:00
{
clean up x86_64 (and x32) atomics for new atomics framework this commit mostly makes consistent things like spacing, function ordering in atomic_arch.h, argument names, use of volatile, etc. a_ctz_l was also removed from x86_64 since atomic.h provides it automatically using a_ctz_64.
2016-01-22 00:53:09 +00:00
__asm__ __volatile__(
"xchg %0, %1"
: "=r"(v), "=m"(*p) : "0"(v) : "memory" );
return v;
optimize contended normal mutex case; add int compare-and-swap atomic
2011-03-17 16:14:40 +00:00
}
clean up x86_64 (and x32) atomics for new atomics framework this commit mostly makes consistent things like spacing, function ordering in atomic_arch.h, argument names, use of volatile, etc. a_ctz_l was also removed from x86_64 since atomic.h provides it automatically using a_ctz_64.
2016-01-22 00:53:09 +00:00
#define a_fetch_add a_fetch_add
static inline int a_fetch_add(volatile int *p, int v)
Port musl to x86-64. One giant commit!
2011-02-15 12:32:09 +00:00
{
clean up x86_64 (and x32) atomics for new atomics framework this commit mostly makes consistent things like spacing, function ordering in atomic_arch.h, argument names, use of volatile, etc. a_ctz_l was also removed from x86_64 since atomic.h provides it automatically using a_ctz_64.
2016-01-22 00:53:09 +00:00
__asm__ __volatile__(
"lock ; xadd %0, %1"
: "=r"(v), "=m"(*p) : "0"(v) : "memory" );
return v;
Port musl to x86-64. One giant commit!
2011-02-15 12:32:09 +00:00
}
refactor internal atomic.h rather than having each arch provide its own atomic.h, there is a new shared atomic.h in src/internal which pulls arch-specific definitions from arc/$(ARCH)/atomic_arch.h. the latter can be extremely minimal, defining only a_cas or new ll/sc type primitives which the shared atomic.h will use to construct everything else. this commit avoids making heavy changes to the individual archs' atomic implementations. definitions which are identical or near-identical to what the new shared atomic.h would produce have been removed, but otherwise the changes made are just hooking up the arch-specific files to the new infrastructure. major changes to take advantage of the new system will come in subsequent commits.
2016-01-21 19:08:54 +00:00
#define a_and a_and
fix inconsistency in a_and and a_or argument types on x86[_64] conceptually, and on other archs, these functions take a pointer to int, but in the i386, x86_64, and x32 versions of atomic.h, they took a pointer to void instead.
2015-05-20 04:17:35 +00:00
static inline void a_and(volatile int *p, int v)
Port musl to x86-64. One giant commit!
2011-02-15 12:32:09 +00:00
{
clean up x86_64 (and x32) atomics for new atomics framework this commit mostly makes consistent things like spacing, function ordering in atomic_arch.h, argument names, use of volatile, etc. a_ctz_l was also removed from x86_64 since atomic.h provides it automatically using a_ctz_64.
2016-01-22 00:53:09 +00:00
__asm__ __volatile__(
"lock ; and %1, %0"
fix inconsistency in a_and and a_or argument types on x86[_64] conceptually, and on other archs, these functions take a pointer to int, but in the i386, x86_64, and x32 versions of atomic.h, they took a pointer to void instead.
2015-05-20 04:17:35 +00:00
: "=m"(*p) : "r"(v) : "memory" );
Port musl to x86-64. One giant commit!
2011-02-15 12:32:09 +00:00
}
clean up x86_64 (and x32) atomics for new atomics framework this commit mostly makes consistent things like spacing, function ordering in atomic_arch.h, argument names, use of volatile, etc. a_ctz_l was also removed from x86_64 since atomic.h provides it automatically using a_ctz_64.
2016-01-22 00:53:09 +00:00
#define a_or a_or
static inline void a_or(volatile int *p, int v)
Port musl to x86-64. One giant commit!
2011-02-15 12:32:09 +00:00
{
clean up x86_64 (and x32) atomics for new atomics framework this commit mostly makes consistent things like spacing, function ordering in atomic_arch.h, argument names, use of volatile, etc. a_ctz_l was also removed from x86_64 since atomic.h provides it automatically using a_ctz_64.
2016-01-22 00:53:09 +00:00
__asm__ __volatile__(
"lock ; or %1, %0"
: "=m"(*p) : "r"(v) : "memory" );
Port musl to x86-64. One giant commit!
2011-02-15 12:32:09 +00:00
}
clean up x86_64 (and x32) atomics for new atomics framework this commit mostly makes consistent things like spacing, function ordering in atomic_arch.h, argument names, use of volatile, etc. a_ctz_l was also removed from x86_64 since atomic.h provides it automatically using a_ctz_64.
2016-01-22 00:53:09 +00:00
#define a_and_64 a_and_64
static inline void a_and_64(volatile uint64_t *p, uint64_t v)
Port musl to x86-64. One giant commit!
2011-02-15 12:32:09 +00:00
{
clean up x86_64 (and x32) atomics for new atomics framework this commit mostly makes consistent things like spacing, function ordering in atomic_arch.h, argument names, use of volatile, etc. a_ctz_l was also removed from x86_64 since atomic.h provides it automatically using a_ctz_64.
2016-01-22 00:53:09 +00:00
__asm__ __volatile(
"lock ; and %1, %0"
: "=m"(*p) : "r"(v) : "memory" );
}
#define a_or_64 a_or_64
static inline void a_or_64(volatile uint64_t *p, uint64_t v)
{
__asm__ __volatile__(
"lock ; or %1, %0"
: "=m"(*p) : "r"(v) : "memory" );
Port musl to x86-64. One giant commit!
2011-02-15 12:32:09 +00:00
}
refactor internal atomic.h rather than having each arch provide its own atomic.h, there is a new shared atomic.h in src/internal which pulls arch-specific definitions from arc/$(ARCH)/atomic_arch.h. the latter can be extremely minimal, defining only a_cas or new ll/sc type primitives which the shared atomic.h will use to construct everything else. this commit avoids making heavy changes to the individual archs' atomic implementations. definitions which are identical or near-identical to what the new shared atomic.h would produce have been removed, but otherwise the changes made are just hooking up the arch-specific files to the new infrastructure. major changes to take advantage of the new system will come in subsequent commits.
2016-01-21 19:08:54 +00:00
#define a_inc a_inc
clean up x86_64 (and x32) atomics for new atomics framework this commit mostly makes consistent things like spacing, function ordering in atomic_arch.h, argument names, use of volatile, etc. a_ctz_l was also removed from x86_64 since atomic.h provides it automatically using a_ctz_64.
2016-01-22 00:53:09 +00:00
static inline void a_inc(volatile int *p)
Port musl to x86-64. One giant commit!
2011-02-15 12:32:09 +00:00
{
clean up x86_64 (and x32) atomics for new atomics framework this commit mostly makes consistent things like spacing, function ordering in atomic_arch.h, argument names, use of volatile, etc. a_ctz_l was also removed from x86_64 since atomic.h provides it automatically using a_ctz_64.
2016-01-22 00:53:09 +00:00
__asm__ __volatile__(
"lock ; incl %0"
: "=m"(*p) : "m"(*p) : "memory" );
Port musl to x86-64. One giant commit!
2011-02-15 12:32:09 +00:00
}
refactor internal atomic.h rather than having each arch provide its own atomic.h, there is a new shared atomic.h in src/internal which pulls arch-specific definitions from arc/$(ARCH)/atomic_arch.h. the latter can be extremely minimal, defining only a_cas or new ll/sc type primitives which the shared atomic.h will use to construct everything else. this commit avoids making heavy changes to the individual archs' atomic implementations. definitions which are identical or near-identical to what the new shared atomic.h would produce have been removed, but otherwise the changes made are just hooking up the arch-specific files to the new infrastructure. major changes to take advantage of the new system will come in subsequent commits.
2016-01-21 19:08:54 +00:00
#define a_dec a_dec
clean up x86_64 (and x32) atomics for new atomics framework this commit mostly makes consistent things like spacing, function ordering in atomic_arch.h, argument names, use of volatile, etc. a_ctz_l was also removed from x86_64 since atomic.h provides it automatically using a_ctz_64.
2016-01-22 00:53:09 +00:00
static inline void a_dec(volatile int *p)
Port musl to x86-64. One giant commit!
2011-02-15 12:32:09 +00:00
{
clean up x86_64 (and x32) atomics for new atomics framework this commit mostly makes consistent things like spacing, function ordering in atomic_arch.h, argument names, use of volatile, etc. a_ctz_l was also removed from x86_64 since atomic.h provides it automatically using a_ctz_64.
2016-01-22 00:53:09 +00:00
__asm__ __volatile__(
"lock ; decl %0"
: "=m"(*p) : "m"(*p) : "memory" );
Port musl to x86-64. One giant commit!
2011-02-15 12:32:09 +00:00
}
refactor internal atomic.h rather than having each arch provide its own atomic.h, there is a new shared atomic.h in src/internal which pulls arch-specific definitions from arc/$(ARCH)/atomic_arch.h. the latter can be extremely minimal, defining only a_cas or new ll/sc type primitives which the shared atomic.h will use to construct everything else. this commit avoids making heavy changes to the individual archs' atomic implementations. definitions which are identical or near-identical to what the new shared atomic.h would produce have been removed, but otherwise the changes made are just hooking up the arch-specific files to the new infrastructure. major changes to take advantage of the new system will come in subsequent commits.
2016-01-21 19:08:54 +00:00
#define a_store a_store
Port musl to x86-64. One giant commit!
2011-02-15 12:32:09 +00:00
static inline void a_store(volatile int *p, int x)
{
clean up x86_64 (and x32) atomics for new atomics framework this commit mostly makes consistent things like spacing, function ordering in atomic_arch.h, argument names, use of volatile, etc. a_ctz_l was also removed from x86_64 since atomic.h provides it automatically using a_ctz_64.
2016-01-22 00:53:09 +00:00
__asm__ __volatile__(
"mov %1, %0 ; lock ; orl $0,(%%rsp)"
: "=m"(*p) : "r"(x) : "memory" );
Port musl to x86-64. One giant commit!
2011-02-15 12:32:09 +00:00
}
refactor internal atomic.h rather than having each arch provide its own atomic.h, there is a new shared atomic.h in src/internal which pulls arch-specific definitions from arc/$(ARCH)/atomic_arch.h. the latter can be extremely minimal, defining only a_cas or new ll/sc type primitives which the shared atomic.h will use to construct everything else. this commit avoids making heavy changes to the individual archs' atomic implementations. definitions which are identical or near-identical to what the new shared atomic.h would produce have been removed, but otherwise the changes made are just hooking up the arch-specific files to the new infrastructure. major changes to take advantage of the new system will come in subsequent commits.
2016-01-21 19:08:54 +00:00
#define a_barrier a_barrier
add explicit barrier operation to internal atomic.h API
2014-10-10 22:17:09 +00:00
static inline void a_barrier()
{
__asm__ __volatile__( "" : : : "memory" );
}
fix regression disabling use of pause instruction for x86 a_spin commits e24984efd5c6ac5ea8e6cb6cd914fa8435d458bc and 16b55298dc4b6a54d287d7494e04542667ef8861 inadvertently disabled the a_spin implementations for i386, x86_64, and x32 by defining a macro named a_pause instead of a_spin. this should not have caused any functional regression, but it inhibited cpu relaxation while spinning for locks. bug reported by George Kulakowski.
2016-03-30 01:22:52 +00:00
#define a_spin a_spin
clean up x86_64 (and x32) atomics for new atomics framework this commit mostly makes consistent things like spacing, function ordering in atomic_arch.h, argument names, use of volatile, etc. a_ctz_l was also removed from x86_64 since atomic.h provides it automatically using a_ctz_64.
2016-01-22 00:53:09 +00:00
static inline void a_spin()
{
__asm__ __volatile__( "pause" : : : "memory" );
}
refactor internal atomic.h rather than having each arch provide its own atomic.h, there is a new shared atomic.h in src/internal which pulls arch-specific definitions from arc/$(ARCH)/atomic_arch.h. the latter can be extremely minimal, defining only a_cas or new ll/sc type primitives which the shared atomic.h will use to construct everything else. this commit avoids making heavy changes to the individual archs' atomic implementations. definitions which are identical or near-identical to what the new shared atomic.h would produce have been removed, but otherwise the changes made are just hooking up the arch-specific files to the new infrastructure. major changes to take advantage of the new system will come in subsequent commits.
2016-01-21 19:08:54 +00:00
#define a_crash a_crash
security hardening: ensure suid programs have valid stdin/out/err this behavior (opening fds 0-2 for a suid program) is explicitly allowed (but not required) by POSIX to protect badly-written suid programs from clobbering files they later open. this commit does add some cost in startup code, but the availability of auxv and the security flag will be useful elsewhere in the future. in particular auxv is needed for static-linked vdso support, which is still waiting to be committed (sorry nik!)
2011-08-23 13:37:39 +00:00
static inline void a_crash()
{
__asm__ __volatile__( "hlt" : : : "memory" );
}
clean up x86_64 (and x32) atomics for new atomics framework this commit mostly makes consistent things like spacing, function ordering in atomic_arch.h, argument names, use of volatile, etc. a_ctz_l was also removed from x86_64 since atomic.h provides it automatically using a_ctz_64.
2016-01-22 00:53:09 +00:00
#define a_ctz_64 a_ctz_64
static inline int a_ctz_64(uint64_t x)
{
__asm__( "bsf %1,%0" : "=r"(x) : "r"(x) );
return x;
}