Обсуждение: BUG #16827: macOS interrupted syscall leads to a crash

The following bug has been logged on the website:

Bug reference:      16827
Logged by:          Ricardo Ungureanu
Email address:      ricardoungureanu@gmail.com
PostgreSQL version: 13.1
Operating system:   macOS 11.0
Description:

Hello,

I am using macOS 11.0 and trying to import a large dump into postgresql.
Under some circumstances, it crashes while importing. 
I inspected the logs and found out a system call is interrupted (" LOG:
could not open file "pg_wal": Interrupted system call"). Apple has added a
new feature in macOS 11.0 to audit security events. I noticed that the
kernel, while waiting on a condition variable, if it receives an interrupt,
will just pass EINTR (error code 4) back to the usermode program. Your
function XLogFileInit does not treat such cases (just ENOENT is checked) and
decides to exit with an abort(). I have attached below the crash file
generated. 

Please let me know if you need more details about this. The bug can be
easily replicated, but a fairly complicated setup has to be done beforehand
(large db dump, macOS 11.0, endpoint security events enabled).

Thanks,
Ricardo



```
Process:               postgres [52997]
Path:                  /Users/USER/*/postgres
Identifier:            postgres
Version:               ???
Code Type:             X86-64 (Native)
Parent Process:        postgres [82]
Responsible:           postgres [82]
User ID:               502

Date/Time:             2021-01-15 14:38:46.907 +0200
OS Version:            macOS 11.1 (20C69)
Report Version:        12
Anonymous UUID:        F608F4B3-1CFC-403F-896B-1127865BDCB5

Sleep/Wake UUID:       385F6270-DB7E-4813-B828-8E66FAEC4B7E

Time Awake Since Boot: 5900 seconds

System Integrity Protection: disabled

Crashed Thread:        0  Dispatch queue: com.apple.main-thread

Exception Type:        EXC_CRASH (SIGABRT)
Exception Codes:       0x0000000000000000, 0x0000000000000000
Exception Note:        EXC_CORPSE_NOTIFY

Application Specific Information:
crashed on child side of fork pre-exec

Thread 0 Crashed:: Dispatch queue: com.apple.main-thread
0   libsystem_kernel.dylib            0x00007fff2030c462 __pthread_kill + 10
1   libsystem_pthread.dylib           0x00007fff2033a610 pthread_kill + 263
2   libsystem_c.dylib                 0x00007fff2028d720 abort + 120
3   postmaster                        0x000000010bd63987 errfinish.cold.2 +
39
4   postmaster                        0x000000010bc816b9 errfinish + 809
(elog.c:590)
5   postmaster                        0x000000010bce1981 XLogFileInit.cold.7 +
65
6   postmaster                        0x000000010b9100d1 XLogFileInit + 1073
(xlog.c:3275)
7   postmaster                        0x000000010b90f048 XLogWrite + 328
(xlog.c:2487)
8   postmaster                        0x000000010b90f6f1 XLogBackgroundFlush +
513 (xlog.c:3137)
9   postmaster                        0x000000010baf5438 WalWriterMain + 584
(walwriter.c:241)
10  postmaster                        0x000000010b924a7e AuxiliaryProcessMain +
1022 (bootstrap.c:459)
11  postmaster                        0x000000010baf0410 StartChildProcess +
560 (postmaster.c:5512)
12  postmaster                        0x000000010baefce6 reaper + 1510
(postmaster.c:3043)
13  libsystem_platform.dylib          0x00007fff2037ed7d _sigtramp + 29
14  libcrypto.1.1.dylib               0x000000010c41f641
evp_EncryptDecryptUpdate + 497
15  postmaster                        0x000000010baee52d PostmasterMain + 3725
(postmaster.c:1412)
16  postmaster                        0x000000010ba593a0 main + 784
(main.c:210)
17  libdyld.dylib                     0x00007fff20355621 start + 1

Thread 0 crashed with X86 Thread State (64-bit):
  rax: 0x0000000000000000  rbx: 0x000000010df2be00  rcx: 0x00007ffee436dc48
rdx: 0x0000000000000000
  rdi: 0x0000000000000303  rsi: 0x0000000000000006  rbp: 0x00007ffee436dc70
rsp: 0x00007ffee436dc48
   r8: 0x00000000000130a8   r9: 0x00007fff8899a0e8  r10: 0x000000010df2be00
r11: 0x0000000000000246
  r12: 0x0000000000000303  r13: 0x0000000000000000  r14: 0x0000000000000006
r15: 0x0000000000000016
  rip: 0x00007fff2030c462  rfl: 0x0000000000000246  cr2:
0x000000010bd63960
  
Logical CPU:     0
Error Code:      0x02000148
Trap Number:     133

Thread 0 instruction stream not available.

Thread 0 last branch register state not available.


Binary Images:
       0x10b88e000 -        0x10bebefff +postmaster (0)
<DD04BB7F-2CF6-3B5F-9A0A-68A08FEE57A1> /Users/USER/*/postmaster
       0x10c042000 -        0x10c1d4fff +libxml2.2.dylib (0)
<B4001343-5647-3C0F-8773-C1745DE6FE86> /Users/USER/*/libxml2.2.dylib
       0x10c21a000 -        0x10c29efff +libssl.1.1.dylib (0)
<CE8454AE-3168-3D30-B599-68FCCC225B34> /Users/USER/*/libssl.1.1.dylib
       0x10c2d7000 -        0x10c553fff +libcrypto.1.1.dylib (0)
<702FBE7E-C3BB-3A93-9DF5-499DF267C48E> /Users/USER/*/libcrypto.1.1.dylib
       0x10c600000 -        0x10c757fff +libicuuc.67.1.dylib (0)
<E373627F-A138-3EED-A3AD-C507DAC6375C> /Users/USER/*/libicuuc.67.1.dylib
       0x10c7d9000 -        0x10c9b7fff +libicui18n.67.1.dylib (0)
<1DC57BAE-4EB9-3B88-A4A0-CB74389DFFBE> /Users/USER/*/libicui18n.67.1.dylib
       0x10de54000 -        0x10deeffff  dyld (832.7.1)
<DEA51514-B4E8-3368-979B-89D0F8397ABC> /usr/lib/dyld
       0x10df6c000 -        0x10fa80fff +libicudata.67.1.dylib (0)
<CD496099-70BA-3AC5-8835-C90968127516> /Users/USER/*/libicudata.67.1.dylib
    0x7fff20070000 -     0x7fff20071fff  libsystem_blocks.dylib (78)
<9CF131C6-16FB-3DD0-B046-9E0B6AB99935>
/usr/lib/system/libsystem_blocks.dylib
    0x7fff20072000 -     0x7fff200a7fff  libxpc.dylib (2038.40.38)
<003A027D-9CE3-3794-A319-88495844662D> /usr/lib/system/libxpc.dylib
    0x7fff200a8000 -     0x7fff200bffff  libsystem_trace.dylib (1277.50.1)
<48C14376-626E-3C81-B0F5-7416E64580C7>
/usr/lib/system/libsystem_trace.dylib
    0x7fff200c0000 -     0x7fff2015efff  libcorecrypto.dylib (1000.60.19)
<92F0211E-506E-3760-A3C2-808BF3905C07> /usr/lib/system/libcorecrypto.dylib
    0x7fff2015f000 -     0x7fff2018bfff  libsystem_malloc.dylib (317.40.8)
<2EF43B96-90FB-3C50-B73E-035238504E33>
/usr/lib/system/libsystem_malloc.dylib
    0x7fff2018c000 -     0x7fff201d0fff  libdispatch.dylib (1271.40.12)
<CEF1460B-1362-381A-AE69-6BCE2D8C215B> /usr/lib/system/libdispatch.dylib
    0x7fff201d1000 -     0x7fff20209fff  libobjc.A.dylib (818.2)
<45EA2DE2-B612-3486-B156-2359CE279159> /usr/lib/libobjc.A.dylib
    0x7fff2020a000 -     0x7fff2020cfff  libsystem_featureflags.dylib
(28.60.1) <7B4EBDDB-244E-3F78-8895-566FE22288F3>
/usr/lib/system/libsystem_featureflags.dylib
    0x7fff2020d000 -     0x7fff20295fff  libsystem_c.dylib (1439.40.11)
<06D9F593-C815-385D-957F-2B5BCC223A8A> /usr/lib/system/libsystem_c.dylib
    0x7fff20296000 -     0x7fff202ebfff  libc++.1.dylib (904.4)
<AE3A940A-7A9C-3F99-B175-3511528D8DFE> /usr/lib/libc++.1.dylib
    0x7fff202ec000 -     0x7fff20304fff  libc++abi.dylib (904.4)
<DDFCBF9C-432D-3B8A-8641-578D2EDDCAD8> /usr/lib/libc++abi.dylib
    0x7fff20305000 -     0x7fff20333fff  libsystem_kernel.dylib (7195.60.75)
<4BD61365-29AF-3234-8002-D989D295FDBB>
/usr/lib/system/libsystem_kernel.dylib
    0x7fff20334000 -     0x7fff2033ffff  libsystem_pthread.dylib (454.60.1)
<8DD3A0BC-2C92-31E3-BBAB-CE923A4342E4>
/usr/lib/system/libsystem_pthread.dylib
    0x7fff20340000 -     0x7fff2037afff  libdyld.dylib (832.7.1)
<2F8A14F5-7CB8-3EDD-85EA-7FA960BBC04E> /usr/lib/system/libdyld.dylib
    0x7fff2037b000 -     0x7fff20384fff  libsystem_platform.dylib (254.60.1)
<3F7F6461-7B5C-3197-ACD7-C8A0CFCC6F55>
/usr/lib/system/libsystem_platform.dylib
    0x7fff20385000 -     0x7fff203b0fff  libsystem_info.dylib (542.40.3)
<0979757C-5F0D-3F5A-9E0E-EBF234B310AF>
/usr/lib/system/libsystem_info.dylib
    0x7fff203b1000 -     0x7fff2084cfff  com.apple.CoreFoundation (6.9 -
1770.300) <EAC298C4-CE3E-3551-A832-42ED9A13EF74>
/System/Library/Frameworks/CoreFoundation.framework/Versions/A/CoreFoundation
    0x7fff2084d000 -     0x7fff20a7cfff  com.apple.LaunchServices (1122.11 -
1122.11) <CAEEC254-68AE-39B5-8452-EC3E1EE8577B>

/System/Library/Frameworks/CoreServices.framework/Versions/A/Frameworks/LaunchServices.framework/Versions/A/LaunchServices
    0x7fff20a7d000 -     0x7fff20b50fff  com.apple.gpusw.MetalTools (1.0 -
1) <C235D5FA-0B9D-3E72-A8CE-67174E1B9E7C>
/System/Library/PrivateFrameworks/MetalTools.framework/Versions/A/MetalTools
    0x7fff20b51000 -     0x7fff20db4fff  libBLAS.dylib (1336.40.1)
<AD2D155C-1294-3D10-817A-F6A581E6ACF1>
/System/Library/Frameworks/Accelerate.framework/Versions/A/Frameworks/vecLib.framework/Versions/A/libBLAS.dylib
    0x7fff20db5000 -     0x7fff20e02fff  com.apple.Lexicon-framework (1.0 -
86.1) <D54364A6-1C4C-33D7-8B24-C753777B3654>
/System/Library/PrivateFrameworks/Lexicon.framework/Versions/A/Lexicon
    0x7fff20e03000 -     0x7fff20e71fff  libSparse.dylib (106)
<60559226-6E4B-3601-B6CA-E3B85B5EB27B>
/System/Library/Frameworks/Accelerate.framework/Versions/A/Frameworks/vecLib.framework/Versions/A/libSparse.dylib
    0x7fff20e72000 -     0x7fff20eeffff  com.apple.SystemConfiguration (1.20
- 1.20) <8524EE4C-628F-315A-9531-44DD83CE275E>
/System/Library/Frameworks/SystemConfiguration.framework/Versions/A/SystemConfiguration
    0x7fff20ef0000 -     0x7fff20f25fff  libCRFSuite.dylib (50)
<6CA29EAA-0585-3682-9AD2-DFD3D87A74D4> /usr/lib/libCRFSuite.dylib
    0x7fff20f26000 -     0x7fff2115dfff  libmecabra.dylib (929.1.1)
<39F5AD50-3AF2-3CFB-BD21-2DC45AA92A91> /usr/lib/libmecabra.dylib
    0x7fff2115e000 -     0x7fff214c1fff  com.apple.Foundation (6.9 -
1770.300) <44A7115B-7FF0-3300-B61B-0FA71B63C715>
/System/Library/Frameworks/Foundation.framework/Versions/C/Foundation
    0x7fff214c2000 -     0x7fff215aefff  com.apple.LanguageModeling (1.0 -
247.1) <BCB1F8A7-54B9-36D1-B742-70DF7657BF0B>
/System/Library/PrivateFrameworks/LanguageModeling.framework/Versions/A/LanguageModeling
    0x7fff221e9000 -     0x7fff2253afff  com.apple.security (7.0 -
59754.60.13) <A20AB68D-51DA-340B-B813-F2AFC81F7143>
/System/Library/Frameworks/Security.framework/Versions/A/Security
    0x7fff2253b000 -     0x7fff2279cfff  libicucore.A.dylib (66109)
<6C0A0196-2778-3035-81CE-7CA48D6C0628> /usr/lib/libicucore.A.dylib
    0x7fff2279d000 -     0x7fff227a6fff  libsystem_darwin.dylib (1439.40.11)
<BD269412-C9D0-32EE-B42B-B09A187A9B95>
/usr/lib/system/libsystem_darwin.dylib
    0x7fff227a7000 -     0x7fff22a8efff  com.apple.CoreServices.CarbonCore
(1307 - 1307) <9C615967-6D8E-307F-B028-6278A4FA7C8C>
/System/Library/Frameworks/CoreServices.framework/Versions/A/Frameworks/CarbonCore.framework/Versions/A/CarbonCore
    0x7fff22ace000 -     0x7fff22b08fff  com.apple.CSStore (1122.11 -
1122.11) <088D0108-AA14-3610-86A0-89D0C605384F>
/System/Library/PrivateFrameworks/CoreServicesStore.framework/Versions/A/CoreServicesStore
    0x7fff22b09000 -     0x7fff22bb6fff  com.apple.framework.IOKit (2.0.2 -
1845.60.2) <F2299682-5884-363F-9069-AA804E712C74>
/System/Library/Frameworks/IOKit.framework/Versions/A/IOKit
    0x7fff22bb7000 -     0x7fff22bc2fff  libsystem_notify.dylib (279.40.4)
<98D74EEF-60D9-3665-B877-7BE1558BA83E>
/usr/lib/system/libsystem_notify.dylib
    0x7fff24030000 -     0x7fff24673fff  libnetwork.dylib (2288.60.5)
<180FE916-8DD6-3385-B231-0C423B7D2BD3> /usr/lib/libnetwork.dylib
    0x7fff24674000 -     0x7fff24b11fff  com.apple.CFNetwork (1209.1 -
1209.1) <60DE4CD6-B5AF-3E0E-8AF1-39ECFC1B8C98>
/System/Library/Frameworks/CFNetwork.framework/Versions/A/CFNetwork
    0x7fff24b12000 -     0x7fff24b20fff  libsystem_networkextension.dylib
(1295.60.5) <F476B1CB-3561-30C5-A78E-44E99B1720A3>
/usr/lib/system/libsystem_networkextension.dylib
    0x7fff24b21000 -     0x7fff24b21fff  libenergytrace.dylib (22)
<9BE5E51A-F531-3D59-BBBC-486FFF97BD30> /usr/lib/libenergytrace.dylib
    0x7fff24b22000 -     0x7fff24b7dfff  libMobileGestalt.dylib (978.60.2)
<F721B185-0E6A-396B-A50F-0F55810D9A67> /usr/lib/libMobileGestalt.dylib
    0x7fff24b7e000 -     0x7fff24b94fff  libsystem_asl.dylib (385)
<940C5BB9-4928-3A63-97F2-132797C8B7E5> /usr/lib/system/libsystem_asl.dylib
    0x7fff24b95000 -     0x7fff24bacfff  com.apple.TCC (1.0 - 1)
<457D5F24-A346-38FC-8FA1-43B0C835E035>
/System/Library/PrivateFrameworks/TCC.framework/Versions/A/TCC
    0x7fff25ec4000 -     0x7fff25edafff  com.apple.ProtocolBuffer (1 -
285.20.8.8.1) <8EE538E7-2BB1-3E29-8FC3-938335998B22>
/System/Library/PrivateFrameworks/ProtocolBuffer.framework/Versions/A/ProtocolBuffer
    0x7fff25edb000 -     0x7fff2609afff  libsqlite3.dylib (321.1)
<D7017429-8D46-3ECB-8B70-4625C74918F3> /usr/lib/libsqlite3.dylib
    0x7fff261ff000 -     0x7fff26274fff  com.apple.AE (918.0.1 - 918.0.1)
<3A298716-A130-345E-B8FF-74194849015E>
/System/Library/Frameworks/CoreServices.framework/Versions/A/Frameworks/AE.framework/Versions/A/AE
    0x7fff26275000 -     0x7fff2627bfff  libdns_services.dylib (1310.60.4)
<61EB26AD-C09E-3140-955E-16BF7DD2D6E3> /usr/lib/libdns_services.dylib
    0x7fff2627c000 -     0x7fff26283fff  libsystem_symptoms.dylib
(1431.60.1) <88F35AAC-746F-3176-81DF-49CE3D285636>
/usr/lib/system/libsystem_symptoms.dylib
    0x7fff26284000 -     0x7fff26408fff  com.apple.Network (1.0 - 1)
<EED4099E-B17C-3E0B-AA8F-78A2D4F26CBF>
/System/Library/Frameworks/Network.framework/Versions/A/Network
    0x7fff26409000 -     0x7fff2642dfff  com.apple.analyticsd (1.0 - 1)
<99FE0234-454F-36FF-9DE9-36B94D8753F9>
/System/Library/PrivateFrameworks/CoreAnalytics.framework/Versions/A/CoreAnalytics
    0x7fff2642e000 -     0x7fff26430fff  libDiagnosticMessagesClient.dylib
(112) <1014A32B-89EE-3ADD-971F-9CB973172F69>
/usr/lib/libDiagnosticMessagesClient.dylib
    0x7fff26431000 -     0x7fff2647dfff
com.apple.spotlight.metadata.utilities (1.0 - 2150.7.2)
<37A1E760-2006-366C-9FAC-FB70227393FB>
/System/Library/PrivateFrameworks/MetadataUtilities.framework/Versions/A/MetadataUtilities
    0x7fff2647e000 -     0x7fff26518fff  com.apple.Metadata (10.7.0 -
2150.7.2) <509C6597-ABB2-3B81-8E09-C51A755CCDA2>
/System/Library/Frameworks/CoreServices.framework/Versions/A/Frameworks/Metadata.framework/Versions/A/Metadata
    0x7fff26519000 -     0x7fff2651ffff  com.apple.DiskArbitration (2.7 -
2.7) <83DED679-BE65-3475-8AFF-D664BBAFA60A>
/System/Library/Frameworks/DiskArbitration.framework/Versions/A/DiskArbitration
    0x7fff26520000 -     0x7fff26bc6fff  com.apple.vImage (8.1 - 544)
<305D97CC-B47C-32FD-9EC5-43259A469A14>
/System/Library/Frameworks/Accelerate.framework/Versions/A/Frameworks/vImage.framework/Versions/A/vImage
    0x7fff27111000 -     0x7fff27120fff  com.apple.OpenDirectory (11.1 -
230.40.1) <7710743E-6F55-342E-88FA-18796CF83700>
/System/Library/Frameworks/OpenDirectory.framework/Versions/A/OpenDirectory
    0x7fff27121000 -     0x7fff27140fff  com.apple.CFOpenDirectory (11.1 -
230.40.1) <32ECCB06-56D8-3704-935B-7D5363B2988E>

/System/Library/Frameworks/OpenDirectory.framework/Versions/A/Frameworks/CFOpenDirectory.framework/Versions/A/CFOpenDirectory
    0x7fff27141000 -     0x7fff27149fff  com.apple.CoreServices.FSEvents
(1290.40.2 - 1290.40.2) <FB18B8D7-C7F5-3CAB-B538-3F4B4E85D1F1>
/System/Library/Frameworks/CoreServices.framework/Versions/A/Frameworks/FSEvents.framework/Versions/A/FSEvents
    0x7fff2714a000 -     0x7fff2716efff
com.apple.coreservices.SharedFileList (144 - 144)
<93D2192D-7A27-3FD4-B3AB-A4DCBF8419B7>

/System/Library/Frameworks/CoreServices.framework/Versions/A/Frameworks/SharedFileList.framework/Versions/A/SharedFileList
    0x7fff2716f000 -     0x7fff27171fff  libapp_launch_measurement.dylib
(14.1) <9E2700C3-E993-3695-988E-FEF798B75E34>
/usr/lib/libapp_launch_measurement.dylib
    0x7fff27172000 -     0x7fff271bafff  com.apple.CoreAutoLayout (1.0 -
21.10.1) <998BC461-F4F5-396E-9798-1C8126AD61DA>
/System/Library/PrivateFrameworks/CoreAutoLayout.framework/Versions/A/CoreAutoLayout
    0x7fff271bb000 -     0x7fff2729dfff  libxml2.2.dylib (34.8)
<68396181-8100-390C-8886-EFB79F5B484C> /usr/lib/libxml2.2.dylib
    0x7fff282ce000 -     0x7fff282defff  libsystem_containermanager.dylib
(318.60.1) <4ED09A19-04CC-3464-9EFB-F674932020B5>
/usr/lib/system/libsystem_containermanager.dylib
    0x7fff282df000 -     0x7fff282f0fff  com.apple.IOSurface (289.3 - 289.3)
<A3B10665-5909-30EE-BE34-F3284D6D5975>
/System/Library/Frameworks/IOSurface.framework/Versions/A/IOSurface
    0x7fff282f1000 -     0x7fff282f9fff  com.apple.IOAccelerator (439.52 -
439.52) <3944C92D-7838-3D2F-A453-9DB15C815D7B>
/System/Library/PrivateFrameworks/IOAccelerator.framework/Versions/A/IOAccelerator
    0x7fff282fa000 -     0x7fff2841ffff  com.apple.Metal (244.32.7 -
244.32.7) <413B81AE-653F-3CF7-B5A4-A4391436E6D1>
/System/Library/Frameworks/Metal.framework/Versions/A/Metal
    0x7fff28f7e000 -     0x7fff28fd9fff
com.apple.MetalPerformanceShaders.MPSCore (1.0 - 1)
<E2377275-53D7-31A0-AEAF-0A0273B99B92>

/System/Library/Frameworks/MetalPerformanceShaders.framework/Versions/A/Frameworks/MPSCore.framework/Versions/A/MPSCore
    0x7fff28fda000 -     0x7fff28fddfff  libsystem_configuration.dylib
(1109.60.2) <C57B346B-0A03-3F87-BCAC-87B702FA0719>
/usr/lib/system/libsystem_configuration.dylib
    0x7fff28fde000 -     0x7fff28fe2fff  libsystem_sandbox.dylib (1441.60.4)
<8CE27199-D633-31D2-AB08-56380A1DA9FB>
/usr/lib/system/libsystem_sandbox.dylib
    0x7fff28fe3000 -     0x7fff28fe4fff  com.apple.AggregateDictionary (1.0
- 1) <7F2AFEBB-FF06-3194-B691-B411F3456962>
/System/Library/PrivateFrameworks/AggregateDictionary.framework/Versions/A/AggregateDictionary
    0x7fff28fe5000 -     0x7fff28fe8fff  com.apple.AppleSystemInfo (3.1.5 -
3.1.5) <250CD2CA-E796-3CB0-9ADD-054998903B1D>
/System/Library/PrivateFrameworks/AppleSystemInfo.framework/Versions/A/AppleSystemInfo
    0x7fff28fe9000 -     0x7fff28feafff  liblangid.dylib (136)
<224DC045-2B60-39AF-B89E-E524175667F5> /usr/lib/liblangid.dylib
    0x7fff28feb000 -     0x7fff2908bfff  com.apple.CoreNLP (1.0 - 245)
<F876FD71-F077-3CF7-B94D-9E05A17E03D7>
/System/Library/PrivateFrameworks/CoreNLP.framework/Versions/A/CoreNLP
    0x7fff2908c000 -     0x7fff29092fff  com.apple.LinguisticData (1.0 -
399) <D1B7F1D5-EB9E-3555-BA57-3611FA153C44>
/System/Library/PrivateFrameworks/LinguisticData.framework/Versions/A/LinguisticData
    0x7fff29093000 -     0x7fff2974ffff  libBNNS.dylib (288.60.2)
<E3FF47D5-7DD9-3A9E-A819-C79B0CC17C03>
/System/Library/Frameworks/Accelerate.framework/Versions/A/Frameworks/vecLib.framework/Versions/A/libBNNS.dylib
    0x7fff29750000 -     0x7fff29923fff  libvDSP.dylib (760.40.6)
<9434101D-E001-357F-9503-9896C6011F52>
/System/Library/Frameworks/Accelerate.framework/Versions/A/Frameworks/vecLib.framework/Versions/A/libvDSP.dylib
    0x7fff29924000 -     0x7fff29936fff  com.apple.CoreEmoji (1.0 - 128)
<7CCFC59A-8746-3E52-AF1D-1B67798E940C>
/System/Library/PrivateFrameworks/CoreEmoji.framework/Versions/A/CoreEmoji
    0x7fff29937000 -     0x7fff29941fff  com.apple.IOMobileFramebuffer
(343.0.0 - 343.0.0) <9A6F913C-EC79-3FC1-A92C-3A1BA96D8DFB>
/System/Library/PrivateFrameworks/IOMobileFramebuffer.framework/Versions/A/IOMobileFramebuffer
    0x7fff29c49000 -     0x7fff29cd5fff  com.apple.securityfoundation (6.0 -
55240.40.4) <5F06D141-62F4-3405-BA72-24673B170A16>
/System/Library/Frameworks/SecurityFoundation.framework/Versions/A/SecurityFoundation
    0x7fff29cd6000 -     0x7fff29cdffff
com.apple.coreservices.BackgroundTaskManagement (1.0 - 104)
<C5E4B35C-FFDA-3423-890F-06DAD1F684F5>
/System/Library/PrivateFrameworks/BackgroundTaskManagement.framework/Versions/A/BackgroundTaskManagement
    0x7fff29ce0000 -     0x7fff29ce4fff  com.apple.xpc.ServiceManagement
(1.0 - 1) <2C03BEB7-915C-3A3A-A44F-A77775E1BFD5>
/System/Library/Frameworks/ServiceManagement.framework/Versions/A/ServiceManagement
    0x7fff29ce5000 -     0x7fff29ce7fff  libquarantine.dylib (119.40.2)
<19D42B9D-3336-3543-AF75-6E605EA31599> /usr/lib/system/libquarantine.dylib
    0x7fff29ce8000 -     0x7fff29cf3fff  libCheckFix.dylib (31)
<3381FC93-F188-348C-9345-5567A7116CEF> /usr/lib/libCheckFix.dylib
    0x7fff29cf4000 -     0x7fff29d0bfff  libcoretls.dylib (169)
<9C244029-6B45-3583-B27F-BB7BBF84D814> /usr/lib/libcoretls.dylib
    0x7fff29d0c000 -     0x7fff29d1cfff  libbsm.0.dylib (68.40.1)
<DC652D50-FA69-3801-9361-004D4D6832D0> /usr/lib/libbsm.0.dylib
    0x7fff29d1d000 -     0x7fff29d66fff  libmecab.dylib (929.1.1)
<B5D8C96C-D3B8-32F8-84F9-A432CEAD4E5C> /usr/lib/libmecab.dylib
    0x7fff29d67000 -     0x7fff29d6cfff  libgermantok.dylib (24)
<F9772A76-7AFA-3E0B-A02C-A61FC6CA8D8B> /usr/lib/libgermantok.dylib
    0x7fff29d6d000 -     0x7fff29d82fff  libLinearAlgebra.dylib (1336.40.1)
<D2826FAB-174C-3CD6-A765-06D83A9A0EDB>

/System/Library/Frameworks/Accelerate.framework/Versions/A/Frameworks/vecLib.framework/Versions/A/libLinearAlgebra.dylib
    0x7fff29d83000 -     0x7fff29faafff
com.apple.MetalPerformanceShaders.MPSNeuralNetwork (1.0 - 1)
<231CF580-952A-32BC-A423-9B9756AC9744>

/System/Library/Frameworks/MetalPerformanceShaders.framework/Versions/A/Frameworks/MPSNeuralNetwork.framework/Versions/A/MPSNeuralNetwork
    0x7fff29fab000 -     0x7fff29ffafff
com.apple.MetalPerformanceShaders.MPSRayIntersector (1.0 - 1)
<65A993E4-3DC2-3152-98D5-A1DF3DB4573F>

/System/Library/Frameworks/MetalPerformanceShaders.framework/Versions/A/Frameworks/MPSRayIntersector.framework/Versions/A/MPSRayIntersector
    0x7fff29ffb000 -     0x7fff2a141fff  com.apple.MLCompute (1.0 - 1)
<BCEA1149-197E-398F-9424-E29B0AD0829F>
/System/Library/Frameworks/MLCompute.framework/Versions/A/MLCompute
    0x7fff2a142000 -     0x7fff2a178fff
com.apple.MetalPerformanceShaders.MPSMatrix (1.0 - 1)
<F719DA57-EAAA-3527-B859-21025722932F>

/System/Library/Frameworks/MetalPerformanceShaders.framework/Versions/A/Frameworks/MPSMatrix.framework/Versions/A/MPSMatrix
    0x7fff2a179000 -     0x7fff2a1b6fff
com.apple.MetalPerformanceShaders.MPSNDArray (1.0 - 1)
<FCCC0D3F-74D2-3107-82B3-E2B500E36AAE>

/System/Library/Frameworks/MetalPerformanceShaders.framework/Versions/A/Frameworks/MPSNDArray.framework/Versions/A/MPSNDArray
    0x7fff2a1b7000 -     0x7fff2a247fff
com.apple.MetalPerformanceShaders.MPSImage (1.0 - 1)
<21527A17-2D6F-3BDF-9A74-F90FA6E26BB3>

/System/Library/Frameworks/MetalPerformanceShaders.framework/Versions/A/Frameworks/MPSImage.framework/Versions/A/MPSImage
    0x7fff2a248000 -     0x7fff2a257fff  com.apple.AppleFSCompression (125 -
1.0) <D1E7DC71-1929-30A8-B73E-268387110608>
/System/Library/PrivateFrameworks/AppleFSCompression.framework/Versions/A/AppleFSCompression
    0x7fff2a258000 -     0x7fff2a265fff  libbz2.1.0.dylib (44)
<0575C0D0-B107-3E53-857F-DEC55998197B> /usr/lib/libbz2.1.0.dylib
    0x7fff2a266000 -     0x7fff2a26afff  libsystem_coreservices.dylib (127)
<A2D875B9-8BA8-33AD-BE92-ADAB915A8D5B>
/usr/lib/system/libsystem_coreservices.dylib
    0x7fff2a26b000 -     0x7fff2a298fff  com.apple.CoreServices.OSServices
(1122.11 - 1122.11) <870F34BE-C0ED-318B-858D-5F1E4757D552>
/System/Library/Frameworks/CoreServices.framework/Versions/A/Frameworks/OSServices.framework/Versions/A/OSServices
    0x7fff2a46e000 -     0x7fff2a480fff  libz.1.dylib (76)
<9F89FD60-03F7-3175-AB34-5112B99E2B8A> /usr/lib/libz.1.dylib
    0x7fff2a481000 -     0x7fff2a4c8fff  libsystem_m.dylib (3186.40.2)
<79820D9E-0FF1-3F20-AF4F-F87EE20CE8C9> /usr/lib/system/libsystem_m.dylib
    0x7fff2a4c9000 -     0x7fff2a4c9fff  libcharset.1.dylib (59)
<414F6A1C-1EBC-3956-AC2D-CCB0458F31AF> /usr/lib/libcharset.1.dylib
    0x7fff2a4ca000 -     0x7fff2a4cffff  libmacho.dylib (973.4)
<28AE1649-22ED-3C4D-A232-29D37F821C39> /usr/lib/system/libmacho.dylib
    0x7fff2a4d0000 -     0x7fff2a4ebfff  libkxld.dylib (7195.60.75)
<3600A314-332A-343D-B45D-D9D8B302545D> /usr/lib/system/libkxld.dylib
    0x7fff2a4ec000 -     0x7fff2a4f7fff  libcommonCrypto.dylib (60178.40.2)
<1D0A75A5-DEC5-39C6-AB3D-E789B8866712>
/usr/lib/system/libcommonCrypto.dylib
    0x7fff2a4f8000 -     0x7fff2a502fff  libunwind.dylib (200.10)
<C5792A9C-DF0F-3821-BC14-238A78462E8A> /usr/lib/system/libunwind.dylib
    0x7fff2a503000 -     0x7fff2a50afff  liboah.dylib (203.13.2)
<FF72E19B-3B02-34D4-A821-3397BB28AC02> /usr/lib/liboah.dylib
    0x7fff2a50b000 -     0x7fff2a515fff  libcopyfile.dylib (173.40.2)
<89483CD4-DA46-3AF2-AE78-FC37CED05ACC> /usr/lib/system/libcopyfile.dylib
    0x7fff2a516000 -     0x7fff2a51dfff  libcompiler_rt.dylib (102.2)
<0DB26EC8-B4CD-3268-B865-C2FC07E4D2AA>
/usr/lib/system/libcompiler_rt.dylib
    0x7fff2a51e000 -     0x7fff2a520fff  libsystem_collections.dylib
(1439.40.11) <D40D8097-0ABF-3645-B065-168F43ACFF4C>
/usr/lib/system/libsystem_collections.dylib
    0x7fff2a521000 -     0x7fff2a523fff  libsystem_secinit.dylib (87.60.1)
<99B5FD99-1A8B-37C1-BD70-04990FA33B1C>
/usr/lib/system/libsystem_secinit.dylib
    0x7fff2a524000 -     0x7fff2a526fff  libremovefile.dylib (49.40.3)
<750012C2-7097-33C3-B796-2766E6CDE8C1> /usr/lib/system/libremovefile.dylib
    0x7fff2a527000 -     0x7fff2a527fff  libkeymgr.dylib (31)
<2C7B58B0-BE54-3A50-B399-AA49C19083A9> /usr/lib/system/libkeymgr.dylib
    0x7fff2a528000 -     0x7fff2a52ffff  libsystem_dnssd.dylib (1310.60.4)
<81EFC44D-450E-3AA3-AC8F-D7EF68F464B4>
/usr/lib/system/libsystem_dnssd.dylib
    0x7fff2a530000 -     0x7fff2a535fff  libcache.dylib (83)
<2F7F7303-DB23-359E-85CD-8B2F93223E2A> /usr/lib/system/libcache.dylib
    0x7fff2a536000 -     0x7fff2a537fff  libSystem.B.dylib (1292.60.1)
<A7FB4899-9E04-37ED-9DD8-8FFF0400879C> /usr/lib/libSystem.B.dylib
    0x7fff2a538000 -     0x7fff2a53bfff  libfakelink.dylib (3)
<34B6DC95-E19A-37C0-B9D0-558F692D85F5> /usr/lib/libfakelink.dylib
    0x7fff2a53c000 -     0x7fff2a53cfff  com.apple.SoftLinking (1.0 - 1)
<90D679B3-DFFD-3604-B89F-1BCF70B3EBA4>
/System/Library/PrivateFrameworks/SoftLinking.framework/Versions/A/SoftLinking
    0x7fff2a53d000 -     0x7fff2a574fff  libpcap.A.dylib (98.40.1)
<E1995A1C-7EEB-3340-B1E1-DD45FA625C12> /usr/lib/libpcap.A.dylib
    0x7fff2a575000 -     0x7fff2a665fff  libiconv.2.dylib (59)
<3E53F735-1D7E-3ABB-BC45-AAA37F535830> /usr/lib/libiconv.2.dylib
    0x7fff2a666000 -     0x7fff2a677fff  libcmph.dylib (8)
<865FA425-831D-3E49-BD1B-14188D2A98AA> /usr/lib/libcmph.dylib
    0x7fff2a678000 -     0x7fff2a6e9fff  libarchive.2.dylib (83.40.4)
<76B2F421-5335-37FB-9CD5-1018878B9E74> /usr/lib/libarchive.2.dylib
    0x7fff2a6ea000 -     0x7fff2a751fff  com.apple.SearchKit (1.4.1 - 1.4.1)
<7BDD2800-BDDC-3DE0-A4A8-B1E855130E3B>
/System/Library/Frameworks/CoreServices.framework/Versions/A/Frameworks/SearchKit.framework/Versions/A/SearchKit
    0x7fff2a752000 -     0x7fff2a753fff  libThaiTokenizer.dylib (3)
<513547CD-5C7F-37BE-A2AD-55A22F279588> /usr/lib/libThaiTokenizer.dylib
    0x7fff2a754000 -     0x7fff2a77bfff  com.apple.applesauce (1.0 - 16.26)
<AE525243-2CE7-373E-994E-C2457611EB3C>
/System/Library/PrivateFrameworks/AppleSauce.framework/Versions/A/AppleSauce
    0x7fff2a77c000 -     0x7fff2a793fff  libapple_nghttp2.dylib (1.41)
<CC004768-6E3B-3D80-9431-61149EBE2E10> /usr/lib/libapple_nghttp2.dylib
    0x7fff2a794000 -     0x7fff2a7a6fff  libSparseBLAS.dylib (1336.40.1)
<CEBD7B0F-A54D-3A43-BD7E-E8BC2C7B7F0C>
/System/Library/Frameworks/Accelerate.framework/Versions/A/Frameworks/vecLib.framework/Versions/A/libSparseBLAS.dylib
    0x7fff2a7a7000 -     0x7fff2a7a8fff
com.apple.MetalPerformanceShaders.MetalPerformanceShaders (1.0 - 1)
<1BFEB124-CF05-342F-BC65-B233EAB661D9>
/System/Library/Frameworks/MetalPerformanceShaders.framework/Versions/A/MetalPerformanceShaders
    0x7fff2a7a9000 -     0x7fff2a7adfff  libpam.2.dylib (28.40.1)
<AE84F5FA-DDB0-3028-AF25-D6B6A12DBA6A> /usr/lib/libpam.2.dylib
    0x7fff2a7ae000 -     0x7fff2a7c6fff  libcompression.dylib (96.40.6)
<45B8B821-8EB6-34FE-92E9-5CBA474499E2> /usr/lib/libcompression.dylib
    0x7fff2a7c7000 -     0x7fff2a7ccfff  libQuadrature.dylib (7)
<FB21F53D-4A40-327F-BD3B-C7C8D08C6A86>
/System/Library/Frameworks/Accelerate.framework/Versions/A/Frameworks/vecLib.framework/Versions/A/libQuadrature.dylib
    0x7fff2a7cd000 -     0x7fff2ab69fff  libLAPACK.dylib (1336.40.1)
<509FBCC6-4ECB-3192-98A6-D0C030E4E9D8>
/System/Library/Frameworks/Accelerate.framework/Versions/A/Frameworks/vecLib.framework/Versions/A/libLAPACK.dylib
    0x7fff2ab6a000 -     0x7fff2abb8fff  com.apple.DictionaryServices (1.2 -
341) <83CDCE83-6B48-35F1-BACF-83240D940777>

/System/Library/Frameworks/CoreServices.framework/Versions/A/Frameworks/DictionaryServices.framework/Versions/A/DictionaryServices
    0x7fff2abb9000 -     0x7fff2abd1fff  liblzma.5.dylib (16)
<A45348BC-AA9C-39D6-A7C3-2246A3EFA34C> /usr/lib/liblzma.5.dylib
    0x7fff2abd2000 -     0x7fff2abd3fff  libcoretls_cfhelpers.dylib (169)
<C0F19E92-DACB-3100-8610-62DEC5E5FB81> /usr/lib/libcoretls_cfhelpers.dylib
    0x7fff2abd4000 -     0x7fff2accdfff  com.apple.APFS (1677.60.23 -
1677.60.23) <8271EE40-CDF5-3E0B-9F42-B49DC7C46C98>
/System/Library/PrivateFrameworks/APFS.framework/Versions/A/APFS
    0x7fff2acce000 -     0x7fff2acdbfff  libxar.1.dylib (452)
<3F3DA942-DC7B-31EF-BCF1-38F99F59A660> /usr/lib/libxar.1.dylib
    0x7fff2acdc000 -     0x7fff2acdffff  libutil.dylib (58.40.2)
<85CF2B3B-6BEB-381D-8683-1DE2B0167ECC> /usr/lib/libutil.dylib
    0x7fff2ace0000 -     0x7fff2ad08fff  libxslt.1.dylib (17.2)
<2C881E82-6E2C-3E92-8DC5-3C2D05FE7C95> /usr/lib/libxslt.1.dylib
    0x7fff2ad09000 -     0x7fff2ad13fff  libChineseTokenizer.dylib (37)
<36891BB5-4A83-33A3-9995-CC5DB2AB53CE> /usr/lib/libChineseTokenizer.dylib
    0x7fff2ad14000 -     0x7fff2add2fff  libvMisc.dylib (760.40.6)
<219319E1-BDBD-34D1-97B7-E46256785D3C>
/System/Library/Frameworks/Accelerate.framework/Versions/A/Frameworks/vecLib.framework/Versions/A/libvMisc.dylib
    0x7fff2b091000 -     0x7fff2b09afff  libheimdal-asn1.dylib (597.40.10)
<032931C8-B042-3B3D-93D3-5B3E27431FEA> /usr/lib/libheimdal-asn1.dylib
    0x7fff2b678000 -     0x7fff2b738fff  com.apple.Heimdal (4.0 - 2.0)
<8BB18335-5DD3-3154-85C8-0145C64556A2>
/System/Library/PrivateFrameworks/Heimdal.framework/Versions/A/Heimdal
    0x7fff2cddf000 -     0x7fff2cdf7fff  libresolv.9.dylib (68)
<9957A6F4-8B66-3429-86CD-6DF4993EB6F5> /usr/lib/libresolv.9.dylib
    0x7fff2cdf8000 -     0x7fff2ce0bfff  libsasl2.2.dylib (214)
<F20902AE-3733-3F37-801D-6C3B78C0008A> /usr/lib/libsasl2.2.dylib
    0x7fff2d724000 -     0x7fff2d733fff  com.apple.Kerberos (3.0 - 1)
<2E872705-0841-3695-AF79-4160D2A436AB>
/System/Library/Frameworks/Kerberos.framework/Versions/A/Kerberos
    0x7fff2d734000 -     0x7fff2d783fff  com.apple.GSS (4.0 - 2.0)
<2A38D59F-5F3A-3779-A421-2F8128F22B95>
/System/Library/Frameworks/GSS.framework/Versions/A/GSS
    0x7fff2d784000 -     0x7fff2d794fff  com.apple.CommonAuth (4.0 - 2.0)
<D9431F22-A16B-3237-9676-B6159B36F5EA>
/System/Library/PrivateFrameworks/CommonAuth.framework/Versions/A/CommonAuth
    0x7fff2d969000 -     0x7fff2d969fff  liblaunch.dylib (2038.40.38)
<05A7EFDD-4111-3E4D-B668-239B69DE3D0F> /usr/lib/system/liblaunch.dylib
    0x7fff2fe16000 -     0x7fff2fe16fff  libsystem_product_info_filter.dylib
(8.40.1) <7CCAF1A8-F570-341E-B275-0C80B092F8E0>
/usr/lib/system/libsystem_product_info_filter.dylib
    0x7fff2fef1000 -     0x7fff2fef1fff  com.apple.Accelerate.vecLib (3.11 -
vecLib 3.11) <510A463F-5CA5-3585-969F-2D44583B71C8>
/System/Library/Frameworks/Accelerate.framework/Versions/A/Frameworks/vecLib.framework/Versions/A/vecLib
    0x7fff2ff18000 -     0x7fff2ff18fff  com.apple.CoreServices (1122.11 -
1122.11) <5DDB040C-6E92-3DBE-9049-873F510F26E2>
/System/Library/Frameworks/CoreServices.framework/Versions/A/CoreServices
    0x7fff301e6000 -     0x7fff301e6fff  com.apple.Accelerate (1.11 -
Accelerate 1.11) <F2FFCC7B-EE3D-3768-A73B-342851B53741>
/System/Library/Frameworks/Accelerate.framework/Versions/A/Accelerate
    0x7fff30253000 -     0x7fff30257fff  com.apple.AppleSRP (5.0 - 1)
<882084C9-F925-308F-B778-398FE6741654>
/System/Library/PrivateFrameworks/AppleSRP.framework/Versions/A/AppleSRP
    0x7fff30258000 -     0x7fff30263fff  com.apple.frameworks.CoreDaemon
(1.3 - 1.3) <96849317-5346-3D5D-95B7-6C48C3015427>
/System/Library/PrivateFrameworks/CoreDaemon.framework/Versions/B/CoreDaemon
    0x7fff32ca4000 -     0x7fff32cdbfff  com.apple.LDAPFramework (2.4.28 -
194.5) <C3E9E36B-B981-3FAD-A8EA-9BADE5F2B30D>
/System/Library/Frameworks/LDAP.framework/Versions/A/LDAP
    0x7fff334ab000 -     0x7fff334abfff  libHeimdalProxy.dylib (79)
<1BD94BF6-8E63-3B21-95DC-E5EEEBFB8AE8>
/System/Library/Frameworks/Kerberos.framework/Versions/A/Libraries/libHeimdalProxy.dylib
    0x7fff6c809000 -     0x7fff6c80ffff  libCoreFSCache.dylib (177.22)
<4ECE128D-5E79-3ADF-8FE7-4FE8F565F8AA>
/System/Library/Frameworks/OpenGL.framework/Versions/A/Libraries/libCoreFSCache.dylib

External Modification Summary:
  Calls made by other processes targeting this process:
    task_for_pid: 2
    thread_create: 0
    thread_set_state: 0
  Calls made by this process:
    task_for_pid: 0
    thread_create: 0
    thread_set_state: 0
  Calls made by all processes on this machine:
    task_for_pid: 3225
    thread_create: 0
    thread_set_state: 0

VM Region Summary:
ReadOnly portion of Libraries: Total=618.6M resident=0K(0%)
swapped_out_or_unallocated=618.6M(100%)
Writable regions: Total=204.9M written=0K(0%) resident=0K(0%)
swapped_out=0K(0%) unallocated=204.9M(100%)
 
                                VIRTUAL   REGION 
REGION TYPE                        SIZE    COUNT (non-coalesced) 
===========                     =======  ======= 
Kernel Alloc Once                    8K        1 
MALLOC                            54.2M       19 
MALLOC guard page                   16K        4 
STACK GUARD                       56.0M        1 
Stack                             8192K        1 
VM_ALLOCATE                      142.2M        5 
__DATA                            3517K      164 
__DATA_CONST                      6360K       97 
__DATA_DIRTY                       291K       60 
__LINKEDIT                       492.9M       10 
__OBJC_RO                         60.5M        1 
__OBJC_RW                         2452K        2 
__TEXT                           125.7M      163 
__UNICODE                          588K        1 
shared memory                        8K        2 
===========                     =======  ======= 
TOTAL                            952.6M      531 
```

Hi,

On 2021-01-15 14:00:03 +0000, PG Bug reporting form wrote:
> I am using macOS 11.0 and trying to import a large dump into postgresql.
> Under some circumstances, it crashes while importing. 
> I inspected the logs and found out a system call is interrupted (" LOG: 
> could not open file "pg_wal": Interrupted system call"). Apple has added a
> new feature in macOS 11.0 to audit security events. I noticed that the
> kernel, while waiting on a condition variable, if it receives an interrupt,
> will just pass EINTR (error code 4) back to the usermode program. Your
> function XLogFileInit does not treat such cases (just ENOENT is checked) and
> decides to exit with an abort(). I have attached below the crash file
> generated.

Hm. It's fairly nasty to return EINTR from open() (except if open()ing a
FIFO or such) - it should normally only happen when blocked. But I'm not
sure it's *actually* violating any standards / promises made.


> Apple has added a new feature in macOS 11.0 to audit security
> events. I noticed that the kernel, while waiting on a condition
> variable, if it receives an interrupt, will just pass EINTR (error
> code 4) back to the usermode program.

Does that also happen for close()? Because that can't reasonably be
handled by userspace (userspace cannot retry because the fd could now
point to something else in a threaded environment).

Greetings,

Andres Freund

Let me give you more context. I am resending this because I forgot to
add the mailing list.
În vin., 15 ian. 2021 la 23:05, Andres Freund <andres@anarazel.de> a scris:
>
> Hi,
>
> On 2021-01-15 14:00:03 +0000, PG Bug reporting form wrote:
> > I am using macOS 11.0 and trying to import a large dump into postgresql.
> > Under some circumstances, it crashes while importing.
> > I inspected the logs and found out a system call is interrupted (" LOG:
> > could not open file "pg_wal": Interrupted system call"). Apple has added a
> > new feature in macOS 11.0 to audit security events. I noticed that the
> > kernel, while waiting on a condition variable, if it receives an interrupt,
> > will just pass EINTR (error code 4) back to the usermode program. Your
> > function XLogFileInit does not treat such cases (just ENOENT is checked) and
> > decides to exit with an abort(). I have attached below the crash file
> > generated.
>
> Hm. It's fairly nasty to return EINTR from open() (except if open()ing a
> FIFO or such) - it should normally only happen when blocked. But I'm not
> sure it's *actually* violating any standards / promises made.

There are two kinds of security events which Apple supports: AUTH and
NOTIFY. AUTH means that the system call is blocked (on that condition
variable I mentioned about), and the user mode daemon is asked about
the generated event: "postgres, pid 999, open() on file /path/file
with flags 0x400003" - something like that. The usermode can either
allow or deny the event by replying. If it decides to block this
system call, the return code seen by the target process (in this case,
postgres) is -1 (operation not permitted) .
On the other hand, NOTIFY events will only log the event, without
requesting a verdict (allow or deny).
In my scenario, usermode daemon responsible for auditing these events
is set to ALLOW everything. If I denied the system call I would see in
postgres log "operation not permitted (err 1)" insead of 'Interrupted
system call (err 4)").
To sum up, the open() is blocked, waiting for a verdict from the
usermode, meanwhile an interrupt is triggered, msleep on the condition
variable returns EINTR and this is passed back to postgres as the
return code of open().

> > Apple has added a new feature in macOS 11.0 to audit security
> > events. I noticed that the kernel, while waiting on a condition
> > variable, if it receives an interrupt, will just pass EINTR (error
> > code 4) back to the usermode program.
>
> Does that also happen for close()? Because that can't reasonably be
> handled by userspace (userspace cannot retry because the fd could now
> point to something else in a threaded environment).

Good point, however the close event is not supported as AUTH, only as
NOTIFY. Thus, this cannot happen on close().
Open() and other file system calls are both AUTH and NOTIFY (you can
choose which one to enable).
You can read more about this here[1]

> Greetings,
>
> Andres Freund

Regards,
Ricardo Ungureanu

[1] https://developer.apple.com/documentation/endpointsecurity/es_event_type_t

Hi,

Tom, all, this seems like a serious problem likely to become more
widespread. I don't really know how we can reasonably address this
short-term, adding EINTR handling to all the places that don't yet have
it (and ensuring that it stays that way) seems like it's a lot to backport.

There's just been another report of this at
https://postgr.es/m/16832-943d33fd58eb26e4%40postgresql.org

On 2021-01-16 19:30:52 +0200, Ricardo Ungureanu wrote:
> În vin., 15 ian. 2021 la 23:05, Andres Freund <andres@anarazel.de> a scris:
> >
> > Hi,
> >
> > On 2021-01-15 14:00:03 +0000, PG Bug reporting form wrote:
> > > I am using macOS 11.0 and trying to import a large dump into postgresql.
> > > Under some circumstances, it crashes while importing.
> > > I inspected the logs and found out a system call is interrupted (" LOG:
> > > could not open file "pg_wal": Interrupted system call"). Apple has added a
> > > new feature in macOS 11.0 to audit security events. I noticed that the
> > > kernel, while waiting on a condition variable, if it receives an interrupt,
> > > will just pass EINTR (error code 4) back to the usermode program. Your
> > > function XLogFileInit does not treat such cases (just ENOENT is checked) and
> > > decides to exit with an abort(). I have attached below the crash file
> > > generated.
> >
> > Hm. It's fairly nasty to return EINTR from open() (except if open()ing a
> > FIFO or such) - it should normally only happen when blocked. But I'm not
> > sure it's *actually* violating any standards / promises made.
> 
> There are two kinds of security events which Apple supports: AUTH and
> NOTIFY. AUTH means that the system call is blocked (on that condition
> variable I mentioned about), and the user mode daemon is asked about
> the generated event: "postgres, pid 999, open() on file /path/file
> with flags 0x400003" - something like that. The usermode can either
> allow or deny the event by replying. If it decides to block this
> system call, the return code seen by the target process (in this case,
> postgres) is -1 (operation not permitted) .
> On the other hand, NOTIFY events will only log the event, without
> requesting a verdict (allow or deny).
> In my scenario, usermode daemon responsible for auditing these events
> is set to ALLOW everything. If I denied the system call I would see in
> postgres log "operation not permitted (err 1)" insead of 'Interrupted
> system call (err 4)").

Does this happens in the default configuration of OSX now? Or is this
something you have manually set up? If manual, why?

Isn't forcing a back-forth context switch for a syscall as common as
open(2) to that auth demon *terrible* for performance?


> To sum up, the open() is blocked, waiting for a verdict from the
> usermode, meanwhile an interrupt is triggered, msleep on the condition
> variable returns EINTR and this is passed back to postgres as the
> return code of open().

> [1] https://developer.apple.com/documentation/endpointsecurity/es_event_type_t

I don't understand how Apple is expecting this to not cause breakage
left and right? Just about no software has EINTR handling for every
syscall (as SA_RESTART is enough), so this seems like it'll lead to a
long tail of bugs.


> > > Apple has added a new feature in macOS 11.0 to audit security
> > > events. I noticed that the kernel, while waiting on a condition
> > > variable, if it receives an interrupt, will just pass EINTR (error
> > > code 4) back to the usermode program.
> >
> > Does that also happen for close()? Because that can't reasonably be
> > handled by userspace (userspace cannot retry because the fd could now
> > point to something else in a threaded environment).
> 
> Good point, however the close event is not supported as AUTH, only as
> NOTIFY. Thus, this cannot happen on close().
> Open() and other file system calls are both AUTH and NOTIFY (you can
> choose which one to enable).
> You can read more about this here[1]

Well, that's at least something.

Greetings,

Andres Freund

Andres Freund <andres@anarazel.de> writes:
> Tom, all, this seems like a serious problem likely to become more
> widespread. I don't really know how we can reasonably address this
> short-term, adding EINTR handling to all the places that don't yet have
> it (and ensuring that it stays that way) seems like it's a lot to backport.

The only idea that comes to mind is to invent a wrapper for open
(and other affected syscalls) that adds a loop-on-EINTR.  Ugly,
and it would not fix third-party extensions until they're recompiled.

My inclination is to regard this as something that's Apple's problem,
at least for now.  Perhaps they'll realize what a disaster it is.
(OTOH, they've proven pretty mulish on making SIP usable...)

            regards, tom lane

On Sat, Jan 16, 2021 at 3:17 AM PG Bug reporting form
<noreply@postgresql.org> wrote:
> I am using macOS 11.0 and trying to import a large dump into postgresql.
> Under some circumstances, it crashes while importing.
> I inspected the logs and found out a system call is interrupted (" LOG:
> could not open file "pg_wal": Interrupted system call"). Apple has added a
> new feature in macOS 11.0 to audit security events. I noticed that the
> kernel, while waiting on a condition variable, if it receives an interrupt,
> will just pass EINTR (error code 4) back to the usermode program. Your
> function XLogFileInit does not treat such cases (just ENOENT is checked) and
> decides to exit with an abort(). I have attached below the crash file
> generated.
>
> Please let me know if you need more details about this. The bug can be
> easily replicated, but a fairly complicated setup has to be done beforehand
> (large db dump, macOS 11.0, endpoint security events enabled).

I wonder if this also explains why pg_test_fsync's final measurement
"non-sync", which does open(), write(), close() in a loop, only
manages around 50k loops per second on an M1 Air, but around a million
on contemporary laptops running Linux and FreeBSD, though I don't have
a Catalina system to compare with.

On Sat, Jan 23, 2021 at 6:47 AM Tom Lane <tgl@sss.pgh.pa.us> wrote:
> Andres Freund <andres@anarazel.de> writes:
> > Tom, all, this seems like a serious problem likely to become more
> > widespread. I don't really know how we can reasonably address this
> > short-term, adding EINTR handling to all the places that don't yet have
> > it (and ensuring that it stays that way) seems like it's a lot to backport.
>
> The only idea that comes to mind is to invent a wrapper for open
> (and other affected syscalls) that adds a loop-on-EINTR.  Ugly,
> and it would not fix third-party extensions until they're recompiled.
>
> My inclination is to regard this as something that's Apple's problem,
> at least for now.  Perhaps they'll realize what a disaster it is.
> (OTOH, they've proven pretty mulish on making SIP usable...)

Can anyone reproduce the problem on 11.3.1+?  This comment seems like
a promising clue that they might have recently made it restartable, or
something like that:

https://github.com/PostgresApp/PostgresApp/issues/610#issuecomment-839210363

On Sun, May 30, 2021 at 01:29:26AM +1200, Thomas Munro wrote:
> Can anyone reproduce the problem on 11.3.1+?  This comment seems like
> a promising clue that they might have recently made it restartable, or
> something like that:
>
> https://github.com/PostgresApp/PostgresApp/issues/610#issuecomment-839210363

FWIW, I have a laptop running now 11.4, and I don't see any random
EINTR popping out for no reasons anymore.  So it seems to me that
there is nothing we need to do here, and that Apple took care of
what they broke.
--
Michael