The main issue is: OSD refuses to start with "ERROR: osd init failed: (1) Operation not permitted"
Log error:
2014-11-13 02:32:32.380964 7f977fd87780 1 journal _open /var/lib/ceph/osd/ceph-289/journal fd 21: 10736369664 bytes, block size 4096 bytes, directio = 1, aio = 1
2014-11-13 02:32:32.393814 7f977fd87780 1 journal _open /var/lib/ceph/osd/ceph-289/journal fd 21: 10736369664 bytes, block size 4096 bytes, directio = 1, aio = 1
2014-11-13 02:32:42.105930 7f977fd87780 1 journal close /var/lib/ceph/osd/ceph-289/journal
2014-11-13 02:32:42.112233 7f977fd87780 -1 ** ERROR: osd init failed: (1) Operation not permitted
Resolution:
- It appears the OSD is having trouble authenticating with the monitor.
- Verify the keyring file is present and correct?
- By default, it is located in /var/lib/ceph/osd/ceph-
/keyring. - It should match the key returned from the command
# ceph auth get osd.