blob: 6f03713b70039020c82f6b12f8f323c2c0853c76 [file] [log] [blame]
Mauro Carvalho Chehabe2862b22017-05-14 14:23:08 -03001===========================
Ohad Ben-Cohenbd9a4c72011-02-17 09:52:03 -08002Hardware Spinlock Framework
Mauro Carvalho Chehabe2862b22017-05-14 14:23:08 -03003===========================
Ohad Ben-Cohenbd9a4c72011-02-17 09:52:03 -08004
Mauro Carvalho Chehabe2862b22017-05-14 14:23:08 -03005Introduction
6============
Ohad Ben-Cohenbd9a4c72011-02-17 09:52:03 -08007
8Hardware spinlock modules provide hardware assistance for synchronization
9and mutual exclusion between heterogeneous processors and those not operating
10under a single, shared operating system.
11
12For example, OMAP4 has dual Cortex-A9, dual Cortex-M3 and a C64x+ DSP,
13each of which is running a different Operating System (the master, A9,
14is usually running Linux and the slave processors, the M3 and the DSP,
15are running some flavor of RTOS).
16
17A generic hwspinlock framework allows platform-independent drivers to use
18the hwspinlock device in order to access data structures that are shared
19between remote processors, that otherwise have no alternative mechanism
20to accomplish synchronization and mutual exclusion operations.
21
22This is necessary, for example, for Inter-processor communications:
23on OMAP4, cpu-intensive multimedia tasks are offloaded by the host to the
24remote M3 and/or C64x+ slave processors (by an IPC subsystem called Syslink).
25
26To achieve fast message-based communications, a minimal kernel support
27is needed to deliver messages arriving from a remote processor to the
28appropriate user process.
29
30This communication is based on simple data structures that is shared between
31the remote processors, and access to it is synchronized using the hwspinlock
32module (remote processor directly places new messages in this shared data
33structure).
34
35A common hwspinlock interface makes it possible to have generic, platform-
36independent, drivers.
37
Mauro Carvalho Chehabe2862b22017-05-14 14:23:08 -030038User API
39========
40
41::
Ohad Ben-Cohenbd9a4c72011-02-17 09:52:03 -080042
43 struct hwspinlock *hwspin_lock_request(void);
Mauro Carvalho Chehabe2862b22017-05-14 14:23:08 -030044
45Dynamically assign an hwspinlock and return its address, or NULL
46in case an unused hwspinlock isn't available. Users of this
47API will usually want to communicate the lock's id to the remote core
48before it can be used to achieve synchronization.
49
50Should be called from a process context (might sleep).
51
52::
Ohad Ben-Cohenbd9a4c72011-02-17 09:52:03 -080053
54 struct hwspinlock *hwspin_lock_request_specific(unsigned int id);
Mauro Carvalho Chehabe2862b22017-05-14 14:23:08 -030055
56Assign a specific hwspinlock id and return its address, or NULL
57if that hwspinlock is already in use. Usually board code will
58be calling this function in order to reserve specific hwspinlock
59ids for predefined purposes.
60
61Should be called from a process context (might sleep).
62
63::
Ohad Ben-Cohenbd9a4c72011-02-17 09:52:03 -080064
Suman Annafb7737e2015-03-04 20:01:14 -060065 int of_hwspin_lock_get_id(struct device_node *np, int index);
Mauro Carvalho Chehabe2862b22017-05-14 14:23:08 -030066
67Retrieve the global lock id for an OF phandle-based specific lock.
68This function provides a means for DT users of a hwspinlock module
69to get the global lock id of a specific hwspinlock, so that it can
70be requested using the normal hwspin_lock_request_specific() API.
71
72The function returns a lock id number on success, -EPROBE_DEFER if
73the hwspinlock device is not yet registered with the core, or other
74error values.
75
76Should be called from a process context (might sleep).
77
78::
Suman Annafb7737e2015-03-04 20:01:14 -060079
Ohad Ben-Cohenbd9a4c72011-02-17 09:52:03 -080080 int hwspin_lock_free(struct hwspinlock *hwlock);
Mauro Carvalho Chehabe2862b22017-05-14 14:23:08 -030081
82Free a previously-assigned hwspinlock; returns 0 on success, or an
83appropriate error code on failure (e.g. -EINVAL if the hwspinlock
84is already free).
85
86Should be called from a process context (might sleep).
87
88::
Ohad Ben-Cohenbd9a4c72011-02-17 09:52:03 -080089
90 int hwspin_lock_timeout(struct hwspinlock *hwlock, unsigned int timeout);
Mauro Carvalho Chehabe2862b22017-05-14 14:23:08 -030091
92Lock a previously-assigned hwspinlock with a timeout limit (specified in
93msecs). If the hwspinlock is already taken, the function will busy loop
94waiting for it to be released, but give up when the timeout elapses.
95Upon a successful return from this function, preemption is disabled so
96the caller must not sleep, and is advised to release the hwspinlock as
97soon as possible, in order to minimize remote cores polling on the
98hardware interconnect.
99
100Returns 0 when successful and an appropriate error code otherwise (most
101notably -ETIMEDOUT if the hwspinlock is still busy after timeout msecs).
102The function will never sleep.
103
104::
Ohad Ben-Cohenbd9a4c72011-02-17 09:52:03 -0800105
106 int hwspin_lock_timeout_irq(struct hwspinlock *hwlock, unsigned int timeout);
Mauro Carvalho Chehabe2862b22017-05-14 14:23:08 -0300107
108Lock a previously-assigned hwspinlock with a timeout limit (specified in
109msecs). If the hwspinlock is already taken, the function will busy loop
110waiting for it to be released, but give up when the timeout elapses.
111Upon a successful return from this function, preemption and the local
112interrupts are disabled, so the caller must not sleep, and is advised to
113release the hwspinlock as soon as possible.
114
115Returns 0 when successful and an appropriate error code otherwise (most
116notably -ETIMEDOUT if the hwspinlock is still busy after timeout msecs).
117The function will never sleep.
118
119::
Ohad Ben-Cohenbd9a4c72011-02-17 09:52:03 -0800120
121 int hwspin_lock_timeout_irqsave(struct hwspinlock *hwlock, unsigned int to,
Mauro Carvalho Chehabe2862b22017-05-14 14:23:08 -0300122 unsigned long *flags);
123
124Lock a previously-assigned hwspinlock with a timeout limit (specified in
125msecs). If the hwspinlock is already taken, the function will busy loop
126waiting for it to be released, but give up when the timeout elapses.
127Upon a successful return from this function, preemption is disabled,
128local interrupts are disabled and their previous state is saved at the
129given flags placeholder. The caller must not sleep, and is advised to
130release the hwspinlock as soon as possible.
131
132Returns 0 when successful and an appropriate error code otherwise (most
133notably -ETIMEDOUT if the hwspinlock is still busy after timeout msecs).
134
135The function will never sleep.
136
137::
Ohad Ben-Cohenbd9a4c72011-02-17 09:52:03 -0800138
Fabien Dessennebce6f522019-03-07 16:58:22 +0100139 int hwspin_lock_timeout_raw(struct hwspinlock *hwlock, unsigned int timeout);
140
141Lock a previously-assigned hwspinlock with a timeout limit (specified in
142msecs). If the hwspinlock is already taken, the function will busy loop
143waiting for it to be released, but give up when the timeout elapses.
144
145Caution: User must protect the routine of getting hardware lock with mutex
146or spinlock to avoid dead-lock, that will let user can do some time-consuming
147or sleepable operations under the hardware lock.
148
149Returns 0 when successful and an appropriate error code otherwise (most
150notably -ETIMEDOUT if the hwspinlock is still busy after timeout msecs).
151
152The function will never sleep.
153
154::
155
Fabien Dessenne360aa642019-03-07 16:58:23 +0100156 int hwspin_lock_timeout_in_atomic(struct hwspinlock *hwlock, unsigned int to);
157
158Lock a previously-assigned hwspinlock with a timeout limit (specified in
159msecs). If the hwspinlock is already taken, the function will busy loop
160waiting for it to be released, but give up when the timeout elapses.
161
162This function shall be called only from an atomic context and the timeout
163value shall not exceed a few msecs.
164
165Returns 0 when successful and an appropriate error code otherwise (most
166notably -ETIMEDOUT if the hwspinlock is still busy after timeout msecs).
167
168The function will never sleep.
169
170::
171
Ohad Ben-Cohenbd9a4c72011-02-17 09:52:03 -0800172 int hwspin_trylock(struct hwspinlock *hwlock);
Mauro Carvalho Chehabe2862b22017-05-14 14:23:08 -0300173
174
175Attempt to lock a previously-assigned hwspinlock, but immediately fail if
176it is already taken.
177
178Upon a successful return from this function, preemption is disabled so
179caller must not sleep, and is advised to release the hwspinlock as soon as
180possible, in order to minimize remote cores polling on the hardware
181interconnect.
182
183Returns 0 on success and an appropriate error code otherwise (most
184notably -EBUSY if the hwspinlock was already taken).
185The function will never sleep.
186
187::
Ohad Ben-Cohenbd9a4c72011-02-17 09:52:03 -0800188
189 int hwspin_trylock_irq(struct hwspinlock *hwlock);
Mauro Carvalho Chehabe2862b22017-05-14 14:23:08 -0300190
191
192Attempt to lock a previously-assigned hwspinlock, but immediately fail if
193it is already taken.
194
195Upon a successful return from this function, preemption and the local
196interrupts are disabled so caller must not sleep, and is advised to
197release the hwspinlock as soon as possible.
198
199Returns 0 on success and an appropriate error code otherwise (most
200notably -EBUSY if the hwspinlock was already taken).
201
202The function will never sleep.
203
204::
Ohad Ben-Cohenbd9a4c72011-02-17 09:52:03 -0800205
206 int hwspin_trylock_irqsave(struct hwspinlock *hwlock, unsigned long *flags);
Mauro Carvalho Chehabe2862b22017-05-14 14:23:08 -0300207
208Attempt to lock a previously-assigned hwspinlock, but immediately fail if
209it is already taken.
210
211Upon a successful return from this function, preemption is disabled,
212the local interrupts are disabled and their previous state is saved
213at the given flags placeholder. The caller must not sleep, and is advised
214to release the hwspinlock as soon as possible.
215
216Returns 0 on success and an appropriate error code otherwise (most
217notably -EBUSY if the hwspinlock was already taken).
218The function will never sleep.
219
220::
Ohad Ben-Cohenbd9a4c72011-02-17 09:52:03 -0800221
Fabien Dessennebce6f522019-03-07 16:58:22 +0100222 int hwspin_trylock_raw(struct hwspinlock *hwlock);
223
224Attempt to lock a previously-assigned hwspinlock, but immediately fail if
225it is already taken.
226
227Caution: User must protect the routine of getting hardware lock with mutex
228or spinlock to avoid dead-lock, that will let user can do some time-consuming
229or sleepable operations under the hardware lock.
230
231Returns 0 on success and an appropriate error code otherwise (most
232notably -EBUSY if the hwspinlock was already taken).
233The function will never sleep.
234
235::
236
Fabien Dessenne360aa642019-03-07 16:58:23 +0100237 int hwspin_trylock_in_atomic(struct hwspinlock *hwlock);
238
239Attempt to lock a previously-assigned hwspinlock, but immediately fail if
240it is already taken.
241
242This function shall be called only from an atomic context.
243
244Returns 0 on success and an appropriate error code otherwise (most
245notably -EBUSY if the hwspinlock was already taken).
246The function will never sleep.
247
248::
249
Ohad Ben-Cohenbd9a4c72011-02-17 09:52:03 -0800250 void hwspin_unlock(struct hwspinlock *hwlock);
Mauro Carvalho Chehabe2862b22017-05-14 14:23:08 -0300251
252Unlock a previously-locked hwspinlock. Always succeed, and can be called
253from any context (the function never sleeps).
254
255.. note::
256
257 code should **never** unlock an hwspinlock which is already unlocked
258 (there is no protection against this).
259
260::
Ohad Ben-Cohenbd9a4c72011-02-17 09:52:03 -0800261
262 void hwspin_unlock_irq(struct hwspinlock *hwlock);
Mauro Carvalho Chehabe2862b22017-05-14 14:23:08 -0300263
264Unlock a previously-locked hwspinlock and enable local interrupts.
265The caller should **never** unlock an hwspinlock which is already unlocked.
266
267Doing so is considered a bug (there is no protection against this).
268Upon a successful return from this function, preemption and local
269interrupts are enabled. This function will never sleep.
270
271::
Ohad Ben-Cohenbd9a4c72011-02-17 09:52:03 -0800272
273 void
274 hwspin_unlock_irqrestore(struct hwspinlock *hwlock, unsigned long *flags);
Mauro Carvalho Chehabe2862b22017-05-14 14:23:08 -0300275
276Unlock a previously-locked hwspinlock.
277
278The caller should **never** unlock an hwspinlock which is already unlocked.
279Doing so is considered a bug (there is no protection against this).
280Upon a successful return from this function, preemption is reenabled,
281and the state of the local interrupts is restored to the state saved at
282the given flags. This function will never sleep.
283
284::
Ohad Ben-Cohenbd9a4c72011-02-17 09:52:03 -0800285
Fabien Dessennebce6f522019-03-07 16:58:22 +0100286 void hwspin_unlock_raw(struct hwspinlock *hwlock);
287
288Unlock a previously-locked hwspinlock.
289
290The caller should **never** unlock an hwspinlock which is already unlocked.
291Doing so is considered a bug (there is no protection against this).
292This function will never sleep.
293
294::
295
Fabien Dessenne360aa642019-03-07 16:58:23 +0100296 void hwspin_unlock_in_atomic(struct hwspinlock *hwlock);
297
298Unlock a previously-locked hwspinlock.
299
300The caller should **never** unlock an hwspinlock which is already unlocked.
301Doing so is considered a bug (there is no protection against this).
302This function will never sleep.
303
304::
305
Ohad Ben-Cohenbd9a4c72011-02-17 09:52:03 -0800306 int hwspin_lock_get_id(struct hwspinlock *hwlock);
Ohad Ben-Cohenbd9a4c72011-02-17 09:52:03 -0800307
Mauro Carvalho Chehabe2862b22017-05-14 14:23:08 -0300308Retrieve id number of a given hwspinlock. This is needed when an
309hwspinlock is dynamically assigned: before it can be used to achieve
310mutual exclusion with a remote cpu, the id number should be communicated
311to the remote task with which we want to synchronize.
Ohad Ben-Cohenbd9a4c72011-02-17 09:52:03 -0800312
Mauro Carvalho Chehabe2862b22017-05-14 14:23:08 -0300313Returns the hwspinlock id number, or -EINVAL if hwlock is null.
Ohad Ben-Cohenbd9a4c72011-02-17 09:52:03 -0800314
Mauro Carvalho Chehabe2862b22017-05-14 14:23:08 -0300315Typical usage
316=============
Ohad Ben-Cohenbd9a4c72011-02-17 09:52:03 -0800317
Mauro Carvalho Chehabe2862b22017-05-14 14:23:08 -0300318::
Ohad Ben-Cohenbd9a4c72011-02-17 09:52:03 -0800319
Mauro Carvalho Chehabe2862b22017-05-14 14:23:08 -0300320 #include <linux/hwspinlock.h>
321 #include <linux/err.h>
Ohad Ben-Cohenbd9a4c72011-02-17 09:52:03 -0800322
Mauro Carvalho Chehabe2862b22017-05-14 14:23:08 -0300323 int hwspinlock_example1(void)
324 {
325 struct hwspinlock *hwlock;
326 int ret;
Ohad Ben-Cohenbd9a4c72011-02-17 09:52:03 -0800327
Mauro Carvalho Chehabe2862b22017-05-14 14:23:08 -0300328 /* dynamically assign a hwspinlock */
329 hwlock = hwspin_lock_request();
330 if (!hwlock)
331 ...
Ohad Ben-Cohenbd9a4c72011-02-17 09:52:03 -0800332
Mauro Carvalho Chehabe2862b22017-05-14 14:23:08 -0300333 id = hwspin_lock_get_id(hwlock);
334 /* probably need to communicate id to a remote processor now */
Ohad Ben-Cohenbd9a4c72011-02-17 09:52:03 -0800335
Mauro Carvalho Chehabe2862b22017-05-14 14:23:08 -0300336 /* take the lock, spin for 1 sec if it's already taken */
337 ret = hwspin_lock_timeout(hwlock, 1000);
338 if (ret)
339 ...
Ohad Ben-Cohenbd9a4c72011-02-17 09:52:03 -0800340
Mauro Carvalho Chehabe2862b22017-05-14 14:23:08 -0300341 /*
342 * we took the lock, do our thing now, but do NOT sleep
343 */
Ohad Ben-Cohenbd9a4c72011-02-17 09:52:03 -0800344
Mauro Carvalho Chehabe2862b22017-05-14 14:23:08 -0300345 /* release the lock */
346 hwspin_unlock(hwlock);
Ohad Ben-Cohenbd9a4c72011-02-17 09:52:03 -0800347
Mauro Carvalho Chehabe2862b22017-05-14 14:23:08 -0300348 /* free the lock */
349 ret = hwspin_lock_free(hwlock);
350 if (ret)
351 ...
Ohad Ben-Cohenbd9a4c72011-02-17 09:52:03 -0800352
Mauro Carvalho Chehabe2862b22017-05-14 14:23:08 -0300353 return ret;
Ohad Ben-Cohenbd9a4c72011-02-17 09:52:03 -0800354 }
355
Mauro Carvalho Chehabe2862b22017-05-14 14:23:08 -0300356 int hwspinlock_example2(void)
357 {
358 struct hwspinlock *hwlock;
359 int ret;
Ohad Ben-Cohenbd9a4c72011-02-17 09:52:03 -0800360
Mauro Carvalho Chehabe2862b22017-05-14 14:23:08 -0300361 /*
362 * assign a specific hwspinlock id - this should be called early
363 * by board init code.
364 */
365 hwlock = hwspin_lock_request_specific(PREDEFINED_LOCK_ID);
366 if (!hwlock)
367 ...
Ohad Ben-Cohenbd9a4c72011-02-17 09:52:03 -0800368
Mauro Carvalho Chehabe2862b22017-05-14 14:23:08 -0300369 /* try to take it, but don't spin on it */
370 ret = hwspin_trylock(hwlock);
371 if (!ret) {
372 pr_info("lock is already taken\n");
373 return -EBUSY;
374 }
Ohad Ben-Cohenbd9a4c72011-02-17 09:52:03 -0800375
Mauro Carvalho Chehabe2862b22017-05-14 14:23:08 -0300376 /*
377 * we took the lock, do our thing now, but do NOT sleep
378 */
379
380 /* release the lock */
381 hwspin_unlock(hwlock);
382
383 /* free the lock */
384 ret = hwspin_lock_free(hwlock);
385 if (ret)
386 ...
387
388 return ret;
389 }
Ohad Ben-Cohenbd9a4c72011-02-17 09:52:03 -0800390
391
Mauro Carvalho Chehabe2862b22017-05-14 14:23:08 -0300392API for implementors
393====================
394
395::
Ohad Ben-Cohenbd9a4c72011-02-17 09:52:03 -0800396
Ohad Ben-Cohen300bab92011-09-06 15:39:21 +0300397 int hwspin_lock_register(struct hwspinlock_device *bank, struct device *dev,
398 const struct hwspinlock_ops *ops, int base_id, int num_locks);
Mauro Carvalho Chehabe2862b22017-05-14 14:23:08 -0300399
400To be called from the underlying platform-specific implementation, in
401order to register a new hwspinlock device (which is usually a bank of
402numerous locks). Should be called from a process context (this function
403might sleep).
404
405Returns 0 on success, or appropriate error code on failure.
406
407::
Ohad Ben-Cohenbd9a4c72011-02-17 09:52:03 -0800408
Ohad Ben-Cohen300bab92011-09-06 15:39:21 +0300409 int hwspin_lock_unregister(struct hwspinlock_device *bank);
Ohad Ben-Cohenbd9a4c72011-02-17 09:52:03 -0800410
Mauro Carvalho Chehabe2862b22017-05-14 14:23:08 -0300411To be called from the underlying vendor-specific implementation, in order
412to unregister an hwspinlock device (which is usually a bank of numerous
413locks).
414
415Should be called from a process context (this function might sleep).
416
417Returns the address of hwspinlock on success, or NULL on error (e.g.
418if the hwspinlock is still in use).
419
420Important structs
421=================
Ohad Ben-Cohenbd9a4c72011-02-17 09:52:03 -0800422
Ohad Ben-Cohen300bab92011-09-06 15:39:21 +0300423struct hwspinlock_device is a device which usually contains a bank
424of hardware locks. It is registered by the underlying hwspinlock
425implementation using the hwspin_lock_register() API.
Ohad Ben-Cohenbd9a4c72011-02-17 09:52:03 -0800426
Mauro Carvalho Chehabe2862b22017-05-14 14:23:08 -0300427::
428
429 /**
430 * struct hwspinlock_device - a device which usually spans numerous hwspinlocks
431 * @dev: underlying device, will be used to invoke runtime PM api
432 * @ops: platform-specific hwspinlock handlers
433 * @base_id: id index of the first lock in this device
434 * @num_locks: number of locks in this device
435 * @lock: dynamically allocated array of 'struct hwspinlock'
436 */
437 struct hwspinlock_device {
438 struct device *dev;
439 const struct hwspinlock_ops *ops;
440 int base_id;
441 int num_locks;
442 struct hwspinlock lock[0];
443 };
Ohad Ben-Cohenbd9a4c72011-02-17 09:52:03 -0800444
Ohad Ben-Cohen300bab92011-09-06 15:39:21 +0300445struct hwspinlock_device contains an array of hwspinlock structs, each
Mauro Carvalho Chehabe2862b22017-05-14 14:23:08 -0300446of which represents a single hardware lock::
Ohad Ben-Cohen300bab92011-09-06 15:39:21 +0300447
Mauro Carvalho Chehabe2862b22017-05-14 14:23:08 -0300448 /**
449 * struct hwspinlock - this struct represents a single hwspinlock instance
450 * @bank: the hwspinlock_device structure which owns this lock
451 * @lock: initialized and used by hwspinlock core
452 * @priv: private data, owned by the underlying platform-specific hwspinlock drv
453 */
454 struct hwspinlock {
455 struct hwspinlock_device *bank;
456 spinlock_t lock;
457 void *priv;
458 };
Ohad Ben-Cohen300bab92011-09-06 15:39:21 +0300459
460When registering a bank of locks, the hwspinlock driver only needs to
461set the priv members of the locks. The rest of the members are set and
462initialized by the hwspinlock core itself.
Ohad Ben-Cohenbd9a4c72011-02-17 09:52:03 -0800463
Mauro Carvalho Chehabe2862b22017-05-14 14:23:08 -0300464Implementation callbacks
465========================
Ohad Ben-Cohenbd9a4c72011-02-17 09:52:03 -0800466
Mauro Carvalho Chehabe2862b22017-05-14 14:23:08 -0300467There are three possible callbacks defined in 'struct hwspinlock_ops'::
Ohad Ben-Cohenbd9a4c72011-02-17 09:52:03 -0800468
Mauro Carvalho Chehabe2862b22017-05-14 14:23:08 -0300469 struct hwspinlock_ops {
470 int (*trylock)(struct hwspinlock *lock);
471 void (*unlock)(struct hwspinlock *lock);
472 void (*relax)(struct hwspinlock *lock);
473 };
Ohad Ben-Cohenbd9a4c72011-02-17 09:52:03 -0800474
475The first two callbacks are mandatory:
476
477The ->trylock() callback should make a single attempt to take the lock, and
Mauro Carvalho Chehabe2862b22017-05-14 14:23:08 -0300478return 0 on failure and 1 on success. This callback may **not** sleep.
Ohad Ben-Cohenbd9a4c72011-02-17 09:52:03 -0800479
480The ->unlock() callback releases the lock. It always succeed, and it, too,
Mauro Carvalho Chehabe2862b22017-05-14 14:23:08 -0300481may **not** sleep.
Ohad Ben-Cohenbd9a4c72011-02-17 09:52:03 -0800482
483The ->relax() callback is optional. It is called by hwspinlock core while
484spinning on a lock, and can be used by the underlying implementation to force
Mauro Carvalho Chehabe2862b22017-05-14 14:23:08 -0300485a delay between two successive invocations of ->trylock(). It may **not** sleep.