File: //lib/python3/dist-packages/cloudinit/distros/__pycache__/__init__.cpython-310.pyc
o
�Ad\� � @ s� d dl Z d dlZd dlZd dlZd dlZd dlZd dlmZ d dl m
Z
m Z m Z m
Z
mZ d dlmZ d dlmZ d dlmZmZmZmZmZmZmZ d dlmZm Z d dl m Z d d l m Z d d
l!m"Z"m#Z#m$Z$m%Z% d d l&m'Z' d d l(m)Z) d
Z*dgdgddgddgddgdgdgg d�g d�dgdd gd � Z+e�,e-�Z.e�/d �Z0g d �Z1ej2ej3 d Z4G d!d"� d"ej5e j6d#�Z7d$e8d%e9fd&d'�Z:d$e8fd(d)�Z;dej<fd*d+�Z=d,d-� Z>d.e8d/ee7 fd0d1�Z? 3d8d4d5�Z@d6d7� ZAdS )9� N)�StringIO)�Any�Mapping�MutableMapping�Optional�Type)�importer)�log)�net� persistence�ssh_util�subp�
temp_utils�
type_utils�util)�LinuxNetworking�
Networking)�hosts)�+ALLOW_EC2_MIRRORS_ON_NON_AWS_INSTANCE_TYPES)�
activators�eni�
network_state� renderers)�parse_net_config_data)�Renderer�all�alpine�arch�debian�ubuntu�freebsd� dragonfly�gentoo�cos�netbsd�openbsd)
� almalinux�amazon�centos�
cloudlinux� eurolinux�fedora�mariner� miraclelinux� openmandriva�photon�rhel�rocky� virtuozzo)�opensusez
opensuse-leapzopensuse-microoszopensuse-tumbleweed�sle_hpcz sle-micro�sles� openEuler� OpenCloudOS� TencentOS) r r r r r" r$ r% �redhat�suser6 r7 z#^[a-z][a-z]-(?:[a-z]+-)+[0-9][a-z]$)�chronyzsystemd-timesyncd�ntp�ntpdate�-c @ s� e Zd ZU dZdZdZdZdZdZdZ dgZ
i Z e e
ee
ef f ed < d
ZeZee ed < d d
dd�ZdZdZdZe
ed< dd� Zdedd
fdd�Z e j dd� �Z d d � Z e!de"ee#j$ fd d ��Z%de&fd d!�Z'd"e&fd#d$�Z(d%d&� Z)d�d'd(�Z*d�d)d*�Z+d�d+d,�Z,d-d.� Z-e j d�d/d0��Z.e j d1d2� �Z/d3d4� Z0d�d5d6�Z1d�d7d8�Z2d�d:d;�Z3d�d<d=�Z4d>d?� Z5d�de6fd@dA�Z7e j d�dBdC��Z8e j dDdE� �Z9dFdG� Z:dHdI� Z;e j d�dJdK��Z<e j dLdM� �Z=e j dNdO� �Z>dPdQ� Z?dRdS� Z@eAdTdU� �ZBdVdW� ZCdXdY� ZDe!dZd[� �ZEd\d]� ZFd^d_� ZGd`da� ZHdbdc� ZIddde� ZJdfdg� ZKdhdi� ZLdjdk� ZMd�dldm�ZNdneOdoe6fdpdq�ZPd�dsdt�ZQd�dudv�ZRd�dwdx�ZSdydz� ZTd{e
de
fd|d}�ZUd~d� ZVde
fd�d��ZWd�d�eOd�e
d�e
fd�d��ZXd
S )��Distroz python3-pipz/usr/libz
/etc/hostsz"/etc/sudoers.d/90-cloud-init-usersz
/etc/hostnamez/usr/share/zoneinfoz root:root�service�renderer_configsN�networking_clsz-Hz-Pz-r)�halt�poweroff�reboot� Fz/etc/resolv.conf�osfamilyc C s || _ || _|| _| �� | _d S �N)�_paths�_cfg�namerB �
networking)�selfrK �cfg�paths� rP �</usr/lib/python3/dist-packages/cloudinit/distros/__init__.py�__init__r s zDistro.__init__�ci_pkl_version�returnc C s$ d| j vs | jj s| �� | _dS dS )z)Perform deserialization fixes for Distro.rL N)�__dict__rL rB )rM rS rP rP rQ � _unpicklex s �zDistro._unpicklec C � t � �rH ��NotImplementedError)rM �pkglistrP rP rQ �install_packages� � zDistro.install_packagesc C s t d| j ��)�=Deprecated. Remove if/when arch and gentoo support renderers.zhLegacy function '_write_network' was called in distro '%s'.
_write_network_config needs implementation.
)rY rK )rM �settingsrP rP rQ �_write_network� s
��zDistro._write_networkc C s6 t �| jdd�}ztj|d�W S tjy Y dS w )z=Return the configured network activator for this environment.)�networkr N��priority)r �get_cfg_by_pathrJ r �select_activator�NoActivatorException)rM rb rP rP rQ �network_activator� s ��zDistro.network_activatorc C sD t �| jdd �}tj|d�\}}t�d||� || j�|�d�}|S )N)r` r ra z-Selected renderer '%s' from priority list: %s)�config) r rc rJ r �select�LOG�debugrA �get)rM rb rK �
render_cls�rendererrP rP rQ �
_get_renderer� s ��zDistro._get_rendererrm c C s |� |� d S rH )�render_network_state)rM r rm rP rP rQ �_write_network_state� � zDistro._write_network_statec C s4 t j�| jt|��}t j�|�std||f ��|S )Nz(Invalid timezone %s, no file found at %s)�os�path�join� tz_zone_dir�str�isfile�IOError)rM �tz�tz_filerP rP rQ �
_find_tz_file� s
�zDistro._find_tz_filec C s | j �||�S rH )rJ rk )rM �opt_name�defaultrP rP rQ �
get_option� rq zDistro.get_optionc C s || j |< d S rH )rJ )rM r| �valuerP rP rQ �
set_option� rq zDistro.set_optionc C s( | � ||�}| �|| j� | �|� d S rH )�_select_hostname�_write_hostname�hostname_conf_fn�_apply_hostname)rM �hostname�fqdn�writeable_hostnamerP rP rQ � set_hostname� s zDistro.set_hostnamec C s t � S )z?Wrapper to report whether this distro uses systemd or sysvinit.)� uses_systemd�rM rP rP rQ r� � r\ zDistro.uses_systemdc C rW rH rX )rM �command�args�pkgsrP rP rQ �package_command� r\ zDistro.package_commandc C rW rH rX r� rP rP rQ �update_package_sources� r\ z Distro.update_package_sourcesc C s t �� d }|dv r dS |S )N� )�i386�i486�i586�i686r� )rr �uname)rM r rP rP rQ �get_primary_arch� s zDistro.get_primary_archc C s" | � dg �}|s | �� }t||�S )N�package_mirrors)r~ r� � _get_arch_package_mirror_info)rM r � mirror_inforP rP rQ r� � s
z$Distro._get_arch_package_mirror_infoc C s | � |�}t||d�S )N)� data_sourcer� )r� �_get_package_mirror_info)rM r r� � arch_inforP rP rQ �get_package_mirror_info� s
�z Distro.get_package_mirror_infoTc C s | � |�}|r | �|�S dS )r] F)r_ �_bring_up_interfaces)rM r^ �bring_up� dev_namesrP rP rQ �
apply_network� s
zDistro.apply_networkc C sL | j }t�d|� d�d| dg�}t�|�}tj||dd�}| j||d�S )r] ziapply_network_config is not currently implemented for distribution '%s'. Attempting to use apply_network�
z-# Converted from network_config for distro %sz4# Implementation of _write_network_config is needed.T)�header�render_hwaddress�r� ) � __class__ri �warningrt r r r �network_state_to_enir� )rM � netconfigr� �distror� �ns�contentsrP rP rQ �"_apply_network_from_network_config� s ���
�z)Distro._apply_network_from_network_configc C s t �� S rH )r
�generate_fallback_configr� rP rP rQ r� � s z Distro.generate_fallback_configc C s� z| � � }W n ty | j||d� Y S w t||d�}| �||� |r=t�d� | j}|s6t�d� dS |� |� dS t�d� dS )a Apply the network config.
If bring_up is True, attempt to bring up the passed in devices. If
devices is None, attempt to bring up devices returned by
_write_network_config.
Returns True if any devices failed to come up, otherwise False.
r� )rm z/Bringing up newly configured network interfacesz>No network activator found, not bringing up network interfacesTz3Not bringing up newly configured network interfacesF)
rn rY r� r rp ri rj rf r� �bring_up_all_interfaces)rM r� r� rm r rf rP rP rQ �apply_network_config s*
��
�
�zDistro.apply_network_configc C rW rH rX )rM �locale�out_fnrP rP rQ � apply_locale' r\ zDistro.apply_localec C rW rH rX )rM ry rP rP rQ � set_timezone+ r\ zDistro.set_timezonec C s dS )Nz 127.0.0.1rP r� rP rP rQ �_get_localhost_ip/ s zDistro._get_localhost_ipc C rW rH rX r� rP rP rQ �
get_locale2 s zDistro.get_localec C rW rH rX )rM �filenamer} rP rP rQ �_read_hostname5 r\ zDistro._read_hostnamec C rW rH rX )rM r� r� rP rP rQ r� 9 r\ zDistro._write_hostnamec C rW rH rX r� rP rP rQ �_read_system_hostname= r\ z Distro._read_system_hostnamec C sF t �d|� z
t�d|g� W d S tjy" t�t d|� Y d S w )Nz2Non-persistently setting the system hostname to %sr� z;Failed to non-persistently adjust the system hostname to %s)ri rj r
�ProcessExecutionErrorr �logexc)rM r� rP rP rQ r� A s �
��zDistro._apply_hostnamec C s& t �| jd| j�r
|r
|S |s|S |S )N�prefer_fqdn_over_hostname)r �get_cfg_option_boolrJ � prefer_fqdn)rM r� r� rP rP rQ r� R s
���zDistro._select_hostnamec C s6 g }| D ]}|t vrtd�|���|�t | � q|S )Nz&No distributions found for osfamily {})�
OSFAMILIES�
ValueError�format�extend)� family_list�distros�familyrP rP rQ �expand_osfamily` s �zDistro.expand_osfamilyc
C s |}| � ||�}|rtj�|�r| �|�}nd }| �� \}}g }|r&||kr+|�|� |r5||kr:||kr:|�|� |rK|rK||krKt�d||� d S t dd� |D ��}t�
d|t |�� |D ]} z| � || � W q_ t
yz t�td|| � Y q_w ||v r�| �|� d S d S )Nz6%s differs from %s, assuming user maintained hostname.c S s g | ]}|r|�qS rP rP )�.0�frP rP rQ �
<listcomp>� � z*Distro.update_hostname.<locals>.<listcomp>z/Attempting to update hostname to %s in %s filesz!Failed to write hostname %s to %s)r� rr rs �existsr� r� �appendri �info�setrj �lenr� rx r r� r� )
rM r� r� �prev_hostname_fn�applying_hostname�
prev_hostname�sys_fn� sys_hostname� update_files�fnrP rP rQ �update_hostnamek sN
��
�� ���zDistro.update_hostnamec
C sz d}t j�| j�rt�t�| j��}n t�d�}tjdd�}| � � }|�
|�}d}|s5|� |||� d}ndd}|D ]*}d } g }
t |�dkrI|d } t |�dkrU|dd � }
| d urc| |krc||
v rcd}q9|r�t
|�} | �||g� |�|� | D ] }t |�dkr�|� ||d � qxt |�dkr�|j |g|�R � qx|r�t� } |r�| �d | � | �d | � tj| j| �� d
d � d S d S ) N� �added��baseFTrF r � z%s
i� )�mode)rr rs r� �hosts_fnr � HostsConfr � load_file� make_headerr� � get_entry� add_entryr� �listr� � del_entriesr �write�
write_file�getvalue)
rM r� r� r� �eh�local_ip� prev_info� need_change�entry�
entry_fqdn�
entry_aliases� new_entriesr� rP rP rQ �update_etc_hosts� sP
�
��zDistro.update_etc_hostsc C s | j stt�| _ | j S )z7Allow distro to determine the preferred ntp client list)�_preferred_ntp_clientsr� �PREFERRED_NTP_CLIENTSr� rP rP rQ �preferred_ntp_clients� s
z Distro.preferred_ntp_clientsc C s t �)r] rX )rM � device_namerP rP rQ �_bring_up_interface� s zDistro._bring_up_interfacec C s0 d}|D ] }| � |�s|d7 }q|dkrdS dS )r] r rF TF)r� )rM � device_names� am_failed�drP rP rQ r� � s
�zDistro._bring_up_interfacesc C s
| � d�S )N� default_user)r~ r� rP rP rQ �get_default_user� s
zDistro.get_default_userc K sj t �|�r
t�d|� dS d|v r|�d�}nd}d|g}d|g}t �� r/|�d� |�d� ddd d
d d d
dddd�
}dddd�}dg}|�d�} | r{t| t �rV| �
d�} t| t �rat� d|� dd� | D �} d�
| �|d< |�d �}
|
r{| �|
� |r�| r�| D ]} t �| �s�| �| � t�d | |� q�d |�� v r�t |d �|d < t|�� �D ]D\} }
| |v r�|
r�t|
t �r�|�|| |
g� | |v r�|�|| d g� q�|�|| |
g� q�| |v r�|
r�|�|| � |�|| � q�|�d �s�|�d!��r|�d"� |�d"� n
|�d#� |�d#� t�d$|� z
tj||d%� W dS t�y4 } z t �td&|� |�d}~ww )'z�
Add a user to the system using standard GNU tools
This should be overriden on distros where useradd is not desirable or
not available.
z!User %s already exists, skipping.N�
create_groupsT�useradd� --extrausersz --commentz--homez--gidz--uidz--groupsz
--passwordz--shellz --expiredatez
--inactivez--selinux-user)
�gecos�homedir�
primary_group�uid�groups�passwd�shell�
expiredate�inactive� selinux_userz--no-user-groupz--systemz
--no-log-init)�
no_user_group�system� no_log_initr r �,z�DEPRECATED: The user %s has a 'groups' config value of type dict which is deprecated and will be removed in a future version of cloud-init. Use a comma-delimited string or array instead: group1,group2.c S s g | ]}|� � �qS rP ��strip)r� �grP rP rQ r� 2 r� z#Distro.add_user.<locals>.<listcomp>r z created group '%s' for user '%s'r �REDACTED�no_create_homer
z-Mz-mzAdding user %s�� logstringzFailed to create user %s)r �is_userri r� �pop�system_is_snappyr� rk �
isinstancerv �split�dictr� rt �is_group� create_grouprj �keys�sorted�itemsr� r
� Exceptionr� )rM rK �kwargsr� � useradd_cmd�log_useradd_cmd� useradd_opts�
useradd_flags� redact_optsr r �group�key�val�erP rP rQ �add_user� s�
��
�
� �
��zDistro.add_userc
K s� |� d�}|� dd�}g d�}|r|�d� |�|� t�d|� z tj||dd�\}}t�d ||� t�|�}|� d
d �} W | S tyU }
z t�td |� |
�d }
~
ww )
zD
Add a snappy user to the system using snappy tools
�snapuser�knownF)�snapz create-userz--sudoerz--jsonz--knownzAdding snap user %sT)r �capturez snap create-user returned: %s:%s�usernameNz Failed to create snap user %s) rk r� ri rj r
r � load_jsonr r� ) rM rK r r+ r, �create_user_cmd�out�err�jobjr/ r) rP rP rQ �
add_snap_usere s(
�
���zDistro.add_snap_userc K s� d|v r
| j |fi |��S | j|fi |�� d|v r&|d r&| �||d � d|v r8|d r8| j||d dd� |�dd�rC| �|� d|v r`|d rT| �||d � n |d du r`t�d |� d
|v r�|d
}t|t �rq|g}n t|t
�r|t |� � �}|d ur�t|t
t tf�s�t�d t|�� g }nt|�p�g }t�t|�|� d
|v r�|�dg �}|s�t�d||d
� dS |d
}tj}|�d|�}|�d|�}tjt|�||d� dS )a}
Creates or partially updates the ``name`` user in the system.
This defers the actual user creation to ``self.add_user`` or
``self.add_snap_user``, and most of the keys in ``kwargs`` will be
processed there if and only if the user does not already exist.
Once the existence of the ``name`` user has been ensured, this method
then processes these keys (for both just-created and pre-existing
users):
* ``plain_text_passwd``
* ``hashed_passwd``
* ``lock_passwd``
* ``sudo``
* ``ssh_authorized_keys``
* ``ssh_redirect_user``
r+ �plain_text_passwd�
hashed_passwdT)�hashed� lock_passwd�sudoFzxDEPRECATED: The user %s has a 'sudo' config value of 'false' which will be dropped after April 2027. Use 'null' instead.�ssh_authorized_keysNzZInvalid type '%s' detected for 'ssh_authorized_keys', expected list, string, dict, or set.�ssh_redirect_user�cloud_public_ssh_keysz^Unable to disable SSH logins for %s given ssh_redirect_user: %s. No cloud public-keys present.z$USERz
$DISABLE_USER)�options)r5 r* �
set_passwdrk r9 �write_sudo_rulesri r� r rv r r� �values�tupler� �typer �setup_user_keys�DISABLE_USER_OPTS�replace)rM rK r r �
cloud_keys�
redirect_user�disable_optionrP rP rQ � create_user� sb
�
� ��
�zDistro.create_userc
C s� dd|gdd|gf}z t dd� |D ��}W n ty/ } ztd|dd � |D �f �|�d
}~ww zt�|� W d
S tyM } z t�td |� |�d
}~ww ) zL
Lock the password of a user, i.e., disable password logins
r z-l�usermodz--lockc s s" � | ] }t �|d �r|V qdS )r N)r
�which)r� �toolrP rP rQ � <genexpr>� � � z%Distro.lock_passwd.<locals>.<genexpr>zBUnable to lock user account '%s'. No tools available. Tried: %s.c S s g | ]}|d �qS )r rP �r� �crP rP rQ r� � r� z&Distro.lock_passwd.<locals>.<listcomp>Nz&Failed to disable password for user %s)�next�
StopIteration� RuntimeErrorr
r r r� ri )rM rK �
lock_tools�cmdr) rP rP rQ r9 � s( �������zDistro.lock_passwdc
C sB z t � dd|g� W d S ty } z t�td|� |�d }~ww )Nr z--expirez Failed to set 'expire' for %s)r
r r r� ri )rM �userr) rP rP rQ �
expire_passwd� s ��zDistro.expire_passwdc
C sf d||f }dg}|r|� d� z
tj||d| d� W dS ty2 } z t�td|� |�d }~ww )Nz%s:%s�chpasswd�-ezchpasswd for %sr z Failed to set password for %sT)r� r
r r r� ri )rM rW r r8 � pass_stringrV r) rP rP rQ r? � s
���zDistro.set_passwd�plist_inr8 c C s< d� dd� |D ��d }dg|rdgng }t�||� d S )Nr� c s s" � | ] \}}d � ||g�V qdS )�:N�rt )r� rK �passwordrP rP rQ rN
rO z"Distro.chpasswd.<locals>.<genexpr>rY rZ )rt r
)rM r\ r8 �payloadrV rP rP rQ rY s ���zDistro.chpasswd� /etc/sudoersc
C s6 d}d}t j�|�rt�|�}d}d}|�� D ]'}|�� }t�d|�}|s&q|� d��� }|s0qt j�
|�}||kr>d} nq|s�z<|s^ddtj dd�d | dg} d
� | �}t�
||d � ndtj dd�d | dg} d
� | �}t�||� t�d ||� W n ty� }
z t�td
|� |
�d }
~
ww t�|d� d S )Nr� FTz^[#|@]includedir\s+(.*)$rF z?# See sudoers(5) for more information on "#include" directives:r� r� z#includedir %sr� � z Added '#includedir %s' to %szFailed to write %si� )rr rs r� r r� �
splitlinesr �re�searchr& �abspathr� rt r� � append_fileri rj rx r� �
ensure_dir) rM rs � sudo_base�sudoers_contents� base_exists�
found_include�line�
include_match� included_dir�linesr) rP rP rQ �ensure_sudo_dir sX
�
�
�
��zDistro.ensure_sudo_dirc
C s6 |s| j }dd| g}t|ttf�r!|D ] }|�d||f � qnt|t�r0|�d||f � n d}t|t�|� ��d� |�}|d7 }| �
t j �
|�� t j �|�s|t�� |g}z
t�|d� |�d� W d S ty{ } z t�td|� | �d } ~ ww z t�||� W d S ty� } z t�td|� | �d } ~ ww ) Nr� z# User rules for %sz%s %sz1Can not create sudoers rule addition with type %rr� rb z Failed to write sudoers file %sz Failed to append sudoers file %s)�
ci_sudoers_fnr r� rB r� rv � TypeErrorr �obj_namert rq rr rs �dirnamer� r r� r� rx r� ri rg )
rM rW �rules� sudo_filerp �rule�msg�contentr� r) rP rP rQ r@ B sD ��
�����zDistro.write_sudo_rulesc C s� d|g}t �� r
|�d� |sg }t �|�r t�d|� n z
t�|� t�d|� W n ty: t � td|� Y nw t
|�dkrd|D ]"}t � |�sRt�d||� qCt�dd d
||g� t�d ||� qCd S d S ) N�groupaddr� z(Skipping creation of existing group '%s'zCreated new group %szFailed to create group %sr zCUnable to add group member '%s' to group '%s'; user does not exist.rK z-az-Gz Added user '%s' to group '%s') r r r� r ri r� r
r� r r� r� r )rM rK �members�
group_add_cmd�memberrP rP rQ r g s4
�
��zDistro.create_groupc
C sl d| j | g}z |dkrdt|� }W n ty' } ztd|f �|�d }~ww ||g }|r4|�|� |S )N�shutdown�nowz+%dz?power_state[delay] must be 'now' or '+m' (minutes). found '%s'.)�shutdown_options_map�intr� rs r� )rM r� �delay�messager� r) r� rP rP rQ �shutdown_command� s& ������
zDistro.shutdown_command�actionc C s� | j }| �� s d|v r*dg}d|gd|gd|gd|gd|gd|gd|gd |gd
�}n|dg|dg|dg|dg|dg|dg|dg|d gd
�}t|�t|| � }tj|d d �S )
z�
Perform the requested action on a service. This handles the common
'systemctl' and 'service' cases and may be overridden in subclasses
as necessary.
May raise ProcessExecutionError
� systemctl�stop�start�enable�disable�restartzreload-or-restartzreload-or-try-restart�status)r� r� r� r� r� �reloadz
try-reloadr� T)r. )�init_cmdr� r� r
)rM r� r@ r� �cmdsrV rP rP rQ �manage_service� s. � �
zDistro.manage_servicec C s( | � � rt�dd||||g� d S t� �)N� localectlzset-x11-keymap)r� r
rY )rM �layout�model�variantr> rP rP rQ �
set_keymap� s �� zDistro.set_keymapc C s. t jdd�}t�|d�s|S tj�| jdd�S )NT)� needs_exe�noexecz
cloud-init�clouddir)r �get_tmp_ancestorr �
has_mount_optrr rs rt � usr_lib_exec)rM �tmp_dirrP rP rQ �get_tmp_exec_path� s zDistro.get_tmp_exec_pathr� r� rW �cwdc K s> |rd|� d�nd}t j dd|d|d d�|� gfi |��S ) a`
Perform a command as the requested user. Behaves like subp()
Note: We pass `PATH` to the user env by using `env`. This could be
probably simplified after bionic EOL by using
`su --whitelist-environment=PATH ...`, more info on:
https://lore.kernel.org/all/20180815110445.4qefy5zx5gfgbqly@ws.net.home/T/
zcd z && r� �sur> z-czenv PATH=$PATH � )r
rt )rM r� rW r� r � directoryrP rP rQ �do_as� s ���z Distro.do_asrH )NN)T)F)ra )r� )Y�__name__�
__module__� __qualname__�pip_package_namer� r� rr r� ru �
default_ownerr� rA r rv r r �__annotations__r� r rB r r r� �_ci_pkl_versionr� �resolve_conf_fnrR r� rV �abc�abstractmethodr[ r_ �propertyr r �NetworkActivatorrf r rn rp r{ r~ r� r� r� r� r� r� r� r� r� r� r� �boolr� r� r� r� r� r� r� r� r� r� � staticmethodr� r� r� r� r� r� r� r* r5 rJ r9 rX r? r� rY rq r@ r r� r� r� r� r� rP rP rP rQ r? \ s�
%
A+
u[
1
% " r? )� metaclass�url�transformationsc C s� zt j�| �}W n
ty Y dS w |j}|du r dS |D ]}||�}|du r,| S q |}|jdur;d�||j�}t j�|j|d��S )a�
Apply transformations to a URL's hostname, return transformed URL.
This is a separate function because unwrapping and rewrapping only the
hostname portion of a URL is complex.
:param url:
The URL to operate on.
:param transformations:
A list of ``(str) -> Optional[str]`` functions, which will be applied
in order to the hostname portion of the URL. If any function
(regardless of ordering) returns None, ``url`` will be returned without
any modification.
:return:
A string whose value is ``url`` with the hostname ``transformations``
applied, or ``None`` if ``url`` is unparseable.
Nz{}:{})�netloc) �urllib�parse�urlsplitr� r� �portr� �
urlunsplit�_replace)r� r� �parts� new_hostname�transformation�
new_netlocrP rP rQ �&_apply_hostname_transformations_to_url� s" ��
r� c s2 t d � dd� dd� � fdd�dd� g}t| |�S )aH
Given a mirror URL, replace or remove any invalid URI characters.
This performs the following actions on the URL's hostname:
* Checks if it is an IP address, returning the URL immediately if it is
* Converts it to its IDN form (see below for details)
* Replaces any non-Letters/Digits/Hyphen (LDH) characters in it with
hyphens
* Removes any leading/trailing hyphens from each domain name label
Before we replace any invalid domain name characters, we first need to
ensure that any valid non-ASCII characters in the hostname will not be
replaced, by ensuring the hostname is in its Internationalized domain name
(IDN) representation (see RFC 5890). This conversion has to be applied to
the whole hostname (rather than just the substitution variables), because
the Punycode algorithm used by IDNA transcodes each part of the hostname as
a whole string (rather than encoding individual characters). It cannot be
applied to the whole URL, because (a) the Punycode algorithm expects to
operate on domain names so doesn't output a valid URL, and (b) non-ASCII
characters in non-hostname parts of the URL aren't encoded via Punycode.
To put this in RFC 5890's terminology: before we remove or replace any
characters from our domain name (which we do to ensure that each label is a
valid LDH Label), we first ensure each label is in its A-label form.
(Note that Python's builtin idna encoding is actually IDNA2003, not
IDNA2008. This changes the specifics of how some characters are encoded to
ASCII, but doesn't affect the logic here.)
:param url:
The URL to operate on.
:return:
A sanitized version of the URL, which will have been IDNA encoded if
necessary, or ``None`` if the generated string is not a parseable URL.
�.c S s t �| �rd S | S rH )r
�
is_ip_address�r� rP rP rQ �<lambda>9 s z&_sanitize_mirror_url.<locals>.<lambda>c S s | � d��d�S )N�idna�ascii)�encode�decoder� rP rP rQ r� < s c s d� � fdd�| D ��S )Nr� c 3 s � | ] }|� v r
|nd V qdS �r> NrP rP ��acceptable_charsrP rQ rN > s �
��9_sanitize_mirror_url.<locals>.<lambda>.<locals>.<genexpr>r^ r� r� rP rQ r� > s �c S s d� dd� | �d�D ��S )Nr� c s s � | ]}|� d �V qdS r� r
)r� �partrP rP rQ rN B s �
�r� )rt r r� rP rP rQ r� B s
�)�LDH_ASCII_CHARSr� )r� r� rP r� rQ �_sanitize_mirror_url s &
�
r� c
C s" | si } i }|r1|j r1|j |d< t�|j �r1|j dd� }tr&d| |d< n |jdkr1d| |d< |r;|jr;|j|d< i }| �di ��� D ]\}}|||< qE| �d i ��� D ]2\}}g } |D ] }
z|
| }W n tyo Y q^w t |�}|d ur}| �
|� q^|| �} | r�| ||< qVt � d
|� |S ) N�availability_zoner ���z%s�
ec2_region�ec2�region�failsafere z filtered distro mirror info: %s)
r� �
_EC2_AZ_RE�matchr �
platform_typer� rk r �KeyErrorr� r� ri rj ) r� r� �
mirror_filter�substr� �resultsrK �mirror�
searchlist�mirrors�tmpl�foundrP rP rQ r� J sD
�
�� r� c C s8 d }| D ]}|� d�}||v r| S d|v r|}q|S )N�archesr} )rk )r� r r} �itemr� rP rP rQ r� } s
�r� rK rT c C sH t �| dtgdg�\}}|std| |f ��t �|d �}t|d�}|S )Nr� r? z1No distribution found for distro %s (searched %s)r )r � find_moduler� � ImportError�
import_module�getattr)rK �locs� looked_locs�mod�clsrP rP rQ �fetch� s ��
r� �
/etc/timezone�/etc/localtimec C sj t �|t| ��� d � |r3|r3tj�|�}|s tj�|�s-|r%t �|� t� ||� d S t �
||� d S )Nr� ) r r� rv �rstriprr rs �islinkr� �del_file�symlink�copy)ry rz �tz_conf�tz_localr� rP rP rQ �set_etc_timezone� s
�r� c C s. z t �d�} t�| j�W S ty Y dS w )Nz/run/systemd/systemF)rr �lstat�stat�S_ISDIR�st_moder )�resrP rP rQ r� � s
�r� )Nr� r� )Br� rr rd r� �string� urllib.parser� �ior �typingr r r r r � cloudinitr r �loggingr
r r r
r r r � cloudinit.distros.networkingr r �cloudinit.distros.parsersr �cloudinit.featuresr �
cloudinit.netr r r r �cloudinit.net.network_stater �cloudinit.net.rendererr � ALL_DISTROSr� � getLoggerr� ri �compiler� r� �
ascii_letters�digitsr� �CloudInitPickleMixin�ABCMetar? rv r� r� r� �search_for_mirrorr� r� r� r� r� rP rP rP rQ �<module> sf $ �
$
+<
�3
�