1 / 70

Influential People

Analysis of Boolean Functions and Complexity Theory Economics Combinatorics Etc. Slides prepared with help of Ricky Rozen. Influential People.

kevork
Download Presentation

Influential People

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. Analysis of Boolean FunctionsandComplexity TheoryEconomicsCombinatoricsEtc.Slides prepared with help of Ricky Rozen

  2. Influential People • The theory of the Influence of Variables on Boolean Functions[KKL,BL,R,M], has been introduced to tackle Social Choice problems and distributed computing. • It has motivated a magnificent body of work, related to • Sharp Threshold [F, FG] • Percolation[BKS] • Economics: Arrow’s Theorem[K] • Hardness of Approximation[DS] Utilizing Harmonic Analysis of Boolean functions… • And the real important question:

  3. Where to go for Dinner? The alternatives Diners would cast their vote in an (electronic) envelope The system would decide –not necessarily according to majority… And what ifsomeone(in Florida?)can flipsome votes influence Power

  4. Boolean Functions • Def: ABoolean function Power set of [n] Choose the location of -1 Choose a sequence of -1 and 1

  5. Noise Sensitivity • The values of the variables may each, independently, flip with probability  • It turns out: one cannot design an f that would be robust to such noise --that is, would, on average, change value w.p. < O(1)-- unless determining the outcome according to very few of the voters

  6. Voting and influence • Def: theinfluence ofi on f is the probability, over a random input x, that f changes its value when i is flipped -1 1 -1 -1 1 1 -1 1 -1 1 -1 1 -1 1 -1 1 1 1 -1 1 1 -1

  7. -1 1 -1 -1 ? 1 -1 1 -1 1 -1 1 -1 1 -1 1 1 1 -1 • Majority:{1,-1}n {1,-1} • Theinfluence of i on Majority is the probability, over a random input x, Majority changes with i • this happens when half of the n-1 coordinate (people) vote -1 and half vote 1. • i.e.

  8. -1 1 -1 -1 1 1 -1 1 -1 1 -1 1 -1 1 -1 1 1 1 -1 1 • Parity: {1,-1}n {1,-1} Always changes the value of parity

  9. -1 1 -1 -1 1 1 -1 1 -1 1 -1 1 -1 1 -1 1 1 1 -1 1 • Dictatorshipi:{1,-1}20 {1,-1} • Dictatorshipi(x)=xi • influence of i on Dictatorshipi= 1. • influence of ji on Dictatorshipi=0.

  10. Average Sensitivity • Def: theAverage­ Sensitivity off(as) is the sum of influences of all coordinates i  [n] : • as(Majority) = n½ • as(Parity) = n • as(dictatorship) =1

  11. When as(f)=1 Def: f is abalancedfunction if it equals -1 exactly half of the times:Ex[f(x)]=0 Can a balanced f have as(f) < 1? What about as(f)=1? Beside dictatorships? Prop: f isbalancedandas(f)=1f is adictatorship.

  12. Representing f as a Polynomial • What would be the monomials over x  P[n] ? • All powers except 0 and 1 cancel out! • Hence, one for each characterS[n] • These are all the multiplicative functions

  13. Fourier-Walsh Transform • Consider all characters • Given any functionlet the Fourier-Walsh coefficients of f be • thus f can be described as

  14. Norms Def:Expectation norm on the function Def:Summation norm on the transform Thm [Parseval]: Hence, for a Boolean f

  15. Distribution over Characters • We may think of the Transform as defining a distribution over the characters.

  16. SimpleObservations • Claim: • For any function f whose range is {-1,0,1}:

  17. Variables` Influence • Recall: influence of an index i [n] on a Boolean function f:{1,-1}n {1,-1} is • Which can be expressed in terms of the Fourier coefficients of fClaim: • And the as:

  18. Fourier Representation of influence Proof: consider the influence function which in Fourier representation is and

  19. If s s.t |s|>1 and then as(f)>1 Balanced f s.t. as(f)=1 is Dict. • Since f is balanced and • So f is linear • For any i s.t. Only i has changed

  20. Expectation and Variance • Claim: • Hence, for any f

  21. First Passage Percolation [BKS] Each edge costs a w/probability ½ and bw/probability½

  22. First Passage Percolation • Consider the Grid • For each edge e of chooseindependentlywe = 1 or we = 2, each with probability ½ • This induces a shortest-path metric on • Thm: The variance of the shortest path from the origin to vertex v is bounded from above by O( |v|/ log |v|) [BKS] • Proof idea: The average sensitivity of shortest-path is bounded by that term

  23. Proof outline • LetGdenote the grid • SPG– the shortest path in G from the origin to v. • Let denote the Grid which differ from G only on we i.e. flip the value of e in G. • Set

  24. Observation If e participates in a shortest path then flipping its value will increase or decrease the SP in 1 ,if e is not in SP - the SP will not change.

  25. Proof cont. • And by [KKL] there is at least one variable whose influence is at least (logn/n)

  26. Graph properties Def: A graph property is a subset of graphs invariant under isomorphism. Def: a monotone graph property is a graph property P s.t. • If P(G) then for every super-graph H of G (namely, a graph on the same set of vertices, which contains all edges of G) P(H) as well. In other words:P: {-1, 1}V2{-1, 1}

  27. Examples of graph properties • G is connected • G is Hamiltonian • G contains a clique of size t • G is not planar • The clique number of G is larger than that of its complement • The diameter of G is at most s • ... etc . • What is the influence of different e on P?

  28. Erdös–Rényi G(n,p)Graph TheErdös-Rényidistribution of random graphs Put an edge between any two vertices w.p.p

  29. Definitions • P – a graph property • (P) - the probability that a random graph on n vertices with edge probability p satisfies P. • GG(n,p) - G is a random graph of n vertices and edge probability p.

  30. Example-Max Clique Probability for choosing an edge • Consider GG(n,p) • The size of the interval of probabilities pfor which the clique number of Gis almost surely k(where k  log n) is of order log-1n. • The threshold interval: The transition between clique numbers k-1 and k. Number of vertices

  31. The probability of having a clique of size k is 1- The probability of having a clique of size k is  • The probability of having a (k + 1)-clique is still small (log-1n). • The value of pmust increase byclog-1n before the probability for having a (k + 1)-clique reaches and another transition interval begins.

  32. Def: Sharp threshold • Sharp threshold in monotone graph property: • The transition from a property being very unlikely to it being very likely is very swift. G satisfies property P GDoes not satisfies property P

  33. Thm: every monotone graph property has a Sharp Threshold[FK] • Let P be any monotone property of graphs on n vertices . If p(P) >  then q(P) > 1- for q=p + c1log(½)/logn Proof idea: show asp’(P), for p’>p, is high

  34. Thm [Margulis-Russo]: For monotonef HenceLemma:For monotonef > 0,  q[p, p+] s.t. asq(f)  1/ Proof: Otherwise p+(f) > 1

  35. Proof [Margulis-Russo]:

  36. Mechanism Design Problem • Nagents, each agent i hasprivateinput tiT. All other information ispublicknowledge. • Each agent i has avaluationfor all items: Each agent wishes to optimize her own utility. • Objective: minimize the objective function, the total payment. • Means: protocol between agents and auctioneer.

  37. Vickery-Clarke-Groves (VCG) • Sealed bid auction • A Truth Revealing protocol, namely, one in which each agent might as well reveal her valuation to the auctioneer • Whereby each agent gets the best (for her) price she could have bid and still win the auction

  38. Shortest Path using VGC • Problem definition: • Communication networkmodeled by a directed graph G and two vertices source s and target t. • Agents= edges in G • Each agent has a cost for sending a single message on her edge denote by te. • Objective: find the shortest (cheapest) path from s to t. • Means: protocol between agents and auctioneer.

  39. 10$ 10$ 50$ 50$ VCG for Shortest-Path Always in the shortest path

  40. How much will we pay? • SP • Every agent will get 1$ more. 1$ 2$ 2$ 1$ 1$ 1$ 1$ 1$ 2$ 1$ 2$ 1$ 1$ 2$

  41. -1 1 -1 -1 1 1 -1 1 -1 1 -1 1 -1 1 -1 1 1 1 -1 1 -1 Juntas • A function is a J-junta if its value depends on only J variables. 1 -1 -1 1 1 1 -1 -1 1 -1 1 1 -1 1 -1 1 • A Dictatorship is 1-junta -1 1 -1 -1 1 1 -1 1 -1 1 -1 1 -1 1 -1 1 1 1 -1 1

  42. [n] [n] I I z x Noise-Sensitivity How often does the value of f changes when the input is perturbed? [n] [n] I I z x

  43. [n] [n] I I z x Noise-Sensitivity • Def(,p,x[n] ): Let 0<<1, and xP([n])Then y~,p,x, if y = (x\I) z where • I~[n] is a noise subset, and • z~ pI is a replacement. Def(-noise-sensitivity): let 0<<1, then [ When p=½ equivalent to flipping each coordinate in x independently w.p. /2.]

  44. Noise-Sensitivity – Cont. • Advantage: very efficiently testable (using only two queries) by a perturbation-test. • Def(perturbation-test): choose x~p, and y~,p,x, check whether f(x)=f(y)The success is proportional to the noise-sensitivity of f. • Prop: the -noise-sensitivity is given by

  45. Relation between Parameters Prop: small ns small high-freq weight Proof: therefore: if ns is small, then Hence the high frequenciesmust have small weights (as ). Prop: small as small high-freq weight Proof:

  46. High vs. Low Frequencies Def: The section of a function f above k is and the low-frequency portion is

  47. Low-degree B.f are Juntas [KS] Theorem:  constant >0 s.t. any Boolean function f:P([n]){-1,1} satisfying is an [,j]-junta for j=O(-2k32k) Corollary: fix a p-biased distribution p overP([n])Let >0 be any parameter. Set k=log1-(½)Then  constant >0 s.t. any Boolean function f:P([n]){-1,1} satisfying is an [,j]-junta for j=O(-2k32k)

  48. Freidgut Theorem Thm: any Boolean f is an [, j]-junta for Proof: • Specify the junta J • Show the complement ofJ has little influence

  49. Long-Code In the long-code the set of legal-words consists of all monotone dictatorships This is the most extensive binary code, as its bits represent all possible binary values over n elements

  50. Long-Code • Encoding an element e[n]: • Eelegally-encodes an element e if Ee = fe T F F T T

More Related