Affected versions: openSUSE Tumbleweed

📖 ~4 min read  •  Source: SUSE advisory openSUSE-SU-2020:0020-1 (see also SUSE bugzilla)

Related CVEs: CVE-2019-19191 CVE-2017-16852

Upstream summary: Shibboleth Service Provider (SP) 3.x before 3.1.0 shipped a spec file that calls chown on files in a directory controlled by the service user (the shibd account) after installation. This allows the user to escalate to root by pointing symlinks to files such as /etc/shadow.

Table of contents
  1. Symptom & Impact
  2. Environment & Reproduction
  3. Root Cause Analysis
  4. Quick Triage
  5. Step-by-Step Diagnosis
  6. Solution – Primary Fix
  7. Solution – Alternative Approaches
  8. Verification & Acceptance Criteria
  9. Rollback Plan
  10. Prevention & Hardening
  11. Related Errors & Cross-Refs
  12. References & Further Reading

Symptom & Impact

Nothing executes libshibsp10 on its own; its code runs inside whatever links against or imports it, so the exposed surface on an openSUSE Tumbleweed host is the union of every process that has loaded it — web workers, cron jobs, mail handlers, backup agents. The package manager replaces the files on disk, but processes already running keep the old build mapped, and virtualenvs, vendored copies and container images each carry their own copy, so a host can report itself patched while still running vulnerable code. libshibsp10 is a library — code loaded by other programs rather than a daemon — so there is no unit to restart and systemctl status libshibsp10 will simply report no such unit; restart its consumers instead.

Environment & Reproduction

Reproduction targets openSUSE Tumbleweed. Confirm release and installed package:

cat /etc/os-release
rpm -q libshibsp10
zypper info libshibsp10 | head -20
zypper lr -E                              # enabled repositories

Exercise the workload that uses libshibsp10 while collecting:

sudo zypper ps  # NATIVE SUSE TOOL, no extra package: every running process still using deleted/replaced files, plus the owning service name
sudo zypper ps -s  # short table (PID, PPID, UID, login, command, service) without the per-file detail
sudo zypper ps -sss  # service names ONLY, one per line - safe to pipe straight into systemctl
sudo journalctl -xe --no-pager | tail -200
sudo tail -200 /var/log/zypp/history
sudo journalctl -k | grep -i apparmor | tail -100
# Bundle evidence for SUSE / community support:
sudo supportconfig -R /var/tmp -B libshibsp10

Root Cause Analysis

Root cause is documented in SUSE advisory openSUSE-SU-2020:0020-1. openSUSE security maintainers shipped fixes in the corresponding libshibsp10 update for openSUSE Tumbleweed; running an outdated build leaves the host exposed to the failure modes described in the advisory. Correlate zypper history with system logs:

sudo zypper history | grep libshibsp10
sudo zypper history --since='-7 days' | tail -40
sudo journalctl -k | grep -i apparmor | tail -100
cat /proc/sys/kernel/tainted   # non-zero = tainted kernel / out-of-tree modules
snapper list | tail -20         # snapshots taken around each zypper transaction

Quick Triage

Run these on openSUSE Tumbleweed to capture the current state of libshibsp10:

rpm -q libshibsp10                              # installed NVR
rpm -V libshibsp10                              # verify shipped files
sudo zypper ref                            # refresh repos
sudo zypper dup --dry-run                  # pending rolling updates
systemctl --failed --no-pager
sudo firewall-cmd --list-all
sudo aa-status                             # AppArmor profiles
rpm -ql libshibsp10 | grep -E '^/(usr/lib|etc)/systemd/(system|user)/[^/]+\.(service|socket|timer|path|target|mount)$'  # the units libshibsp10 REALLY ships - NO OUTPUT means it ships no service at all, so never run systemctl on it
rpm -ql libshibsp10 | grep -E '^/usr/sbin/rc[^/]+$'  # SUSE-only rcNAME compat symlink (it points at /usr/sbin/service, not at a unit): the NAME after 'rc' IS the service name - bind ships /usr/sbin/rcnamed, so the unit is named.service

Step-by-Step Diagnosis

  1. List failed systemd units.

    systemctl --failed --no-pager
  2. Tail the journal for libshibsp10 and the system bus.

    sudo journalctl -xe -f --no-pager
  3. Inspect firewall posture (firewalld is the default on openSUSE).

    sudo firewall-cmd --list-all-zones --permanent
    sudo nft list ruleset 2>/dev/null | head -50
  4. Surface AppArmor denials and switch the profile to complain mode if needed.

    sudo journalctl -k | grep -i 'apparmor="DENIED"' | tail -30
    sudo aa-status
  5. Verify libshibsp10 integrity and reinstall if anything is altered.

    sudo rpm -V libshibsp10
    sudo zypper verify
    sudo zypper install --force libshibsp10
  6. Inspect Snapper snapshots to know exactly which transaction introduced the regression.

    sudo snapper list | tail -20
    sudo snapper status <pre-id>..<post-id>
  7. Correlate findings with /var/log/zypp/history, zypper history, and SUSE advisory openSUSE-SU-2020:0020-1 to pin the change that introduced the regression.

Solution – Primary Fix

Apply the corrective zypper transaction referenced by SUSE advisory openSUSE-SU-2020:0020-1, then reload affected systemd units:

sudo zypper ref                                      # refresh repos
# Tumbleweed is a rolling release — use 'dup', not 'patch':
sudo zypper dup --no-allow-vendor-change             # rolling distribution upgrade
# To target only the affected package while still on rolling:
sudo zypper dup --no-allow-vendor-change libshibsp10
sudo systemctl daemon-reload
# Unit name may differ from pkg name; check first:
sudo systemctl daemon-reload  # load unit files replaced by the update; this alone restarts nothing
sudo systemctl restart UNIT1.service UNIT2.service  # restart several in ONE transaction - systemd applies their own After=/Before= ordering, so low-level units (dbus, database, broker) go before their consumers
sudo systemctl restart UNIT.service  # NOTE: 'systemctl reload' is NOT enough after a library patch - the process must re-exec to map the new .so
sudo systemctl reload apparmor.service  # only if 'rpm -ql libshibsp10 | grep /etc/apparmor.d/' showed the package ships AppArmor profiles
rpm -q libshibsp10                                          # confirm new NVR

For kernel / glibc / systemd / openssl rolls a reboot is required. Tumbleweed does not ship Live Patching, so plan a maintenance window or use Snapper to roll back if a regression appears:

sudo zypper ps -s                      # services using deleted libs
sudo snapper list | tail -5            # confirm pre/post snapshots exist
sudo systemctl reboot                  # or: sudo shutdown -r now

Need help rolling this patch across an openSUSE fleet? Our IT Solutions & Services team supports openSUSE Leap and Tumbleweed estates with snapper-backed rollback workflows and salt-driven patching. Get in touch for a free consultation.

Solution – Alternative Approaches

If the primary fix is not viable, choose from these:

  • Roll back via Snapper (Btrfs snapshots are taken automatically before zypper transactions on openSUSE Tumbleweed). This is the primary safety net for openSUSE administrators:

    sudo snapper list
    sudo snapper status <pre-id>..<post-id>   # diff between two snapshot numbers
    sudo snapper undochange <pre-id>..<post-id>
    sudo snapper rollback <pre-id>            # boot the host into the chosen snapshot
    sudo systemctl reboot
  • Lock the package so zypper cannot upgrade it:

    sudo zypper al libshibsp10                   # add lock
    zypper ll | grep libshibsp10                 # list locks
    sudo zypper rl libshibsp10                   # remove lock
  • Install an older NVR if a regression is suspected:

    zypper se -s libshibsp10                     # show all available versions
    sudo zypper install --oldpackage libshibsp10-<older-NVR>
  • Disable the AppArmor profile briefly to confirm policy is the cause, then re-enable:

    # reproduce, capture denials in the journal:
    sudo journalctl -k | grep apparmor | tail
  • Pin Tumbleweed to a known-good snapshot from the openSUSE history server while you investigate. This keeps the rolling release reproducible across a fleet:

    # Edit /etc/zypp/repos.d/repo-oss.repo and point baseurl at
    #   http://download.opensuse.org/history/<YYYYMMDD>/tumbleweed/repo/oss/
    sudo zypper ref
    sudo zypper dup --no-allow-vendor-change

Verification & Acceptance Criteria

All of these should pass after the fix:

rpm -q libshibsp10                                            # expected fixed NVR
sudo zypper dup --dry-run                                # no pending rolls expected
sudo firewall-cmd --list-services
sudo aa-status | head -5
sudo zypper ps -s                                        # any services still using deleted libs

The conditions described in the advisory must no longer be reported for libshibsp10 across two consecutive runs.

Rollback Plan

Capture state before any change. On openSUSE, Snapper is the canonical rollback path:

rpm -qa > /root/rpm-pre.txt
sudo zypper history list > /root/zypper-history-pre.txt
# Snapper takes pre/post snapshots automatically on Btrfs root.
sudo snapper create -d 'pre-patch-libshibsp10'   # explicit named snapshot
sudo snapper list | head

To revert if the patch / roll is bad:

# Preferred on Btrfs root — boot the prior snapshot:
sudo snapper list
sudo snapper rollback <pre-id>
sudo systemctl reboot
# Or downgrade just the package:
sudo zypper install --oldpackage libshibsp10-<older-NVR>
sudo systemctl daemon-reload
# Custom AppArmor profile cleanup:

Prevention & Hardening

Reduce the chance of this recurring on openSUSE Tumbleweed:

  • Run rolling upgrades on a schedule — Tumbleweed receives a snapshot most weekdays. Stagger across the fleet so any regression is caught early:

    sudo zypper ref
    sudo zypper dup --no-allow-vendor-change
    # Optional: drive from salt/ansible with a maintenance window per host group.
  • Subscribe to opensuse-security-announce and watch suse.com/support/update.

  • Lock sensitive packages so they cannot be auto-upgraded:

    sudo zypper al libshibsp10
  • Ensure Snapper is enabled on the root subvolume and pre/post hooks run for every zypper transaction. This is the cornerstone of safe openSUSE patching:

    sudo snapper -c root get-config | head
    # Default zypper plugin: /usr/lib/zypp/plugins/commit/snapper.zypp-commit-plugin
    sudo snapper list | tail -10
  • Monitor file integrity with AIDE:

    sudo zypper install -y aide
    sudo aide --init && sudo mv /var/lib/aide/aide.db.new /var/lib/aide/aide.db
    sudo aide --check
  • Keep AppArmor profiles in enforce; review /etc/apparmor.d/ after every package upgrade.

  • Apply CIS / openSUSE hardening guidance and use salt or ansible to enforce baseline state across the fleet.

Issues that commonly surface alongside a libshibsp10 update: zypper lock contention, systemd unit ordering cycles, AppArmor denials, firewalld zone drift, and kernel taint flags. Useful triage:

sudo zypper ps -s
systemd-analyze critical-chain
sudo journalctl -k | grep apparmor | tail
sudo firewall-cmd --get-active-zones
cat /proc/sys/kernel/tainted
sudo snapper list | tail

View all opensuse-tumbleweed tutorials on the Tutorials Hub →

Browse all common problems & solutions on the Tutorials Hub.

References & Further Reading

Primary reference: SUSE advisory openSUSE-SU-2020:0020-1 (see also SUSE bugzilla). Manual pages useful on openSUSE Tumbleweed:

man zypper
man zypper.conf
man systemctl
man journalctl
man firewall-cmd
man snapper
man apparmor
man aa-status

Other resources: openSUSE documentation, suse.com/security, openSUSE security portal, and per-package notes in /usr/share/doc/packages/libshibsp10/ for components implicated in this advisory.


View all openSUSE Tumbleweed tutorials on the Tutorials Hub →